Skip to main content
SpringerLink
Log in

RGBD Sensors for Human Activity Detection in AAL Environments

  • Conference paper
  • First Online:
Ambient Assisted Living

Abstract

This paper aims to propose a novel idea of an embedded intelligent system where a low cost embedded vision system can analyze human behaviors to obtain interactivity and statistical data, mainly devoted to human behavior analysis in Ambient Assisted Living environments. We construct a system that uses vertical RGBD sensor for people tracking and interaction analysis, where the depth information has been used to remove the affect of the appearance variation and to evaluate users activities inside the home and in front of the fixtures. Also group interactions are monitored and analyzed with the main goal of having a better knowledge of the users activities, using real data in real time. All information coming from this human behavior analysis tool can be used to provide basic data gathered in real time for an Ambient Assisted Living environment. Even if preliminary, the results are convincing and most of all the general architecture is affordable in this specific application, robust, easy to install and to maintain and low cost.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ascani, A., Frontoni, E., Mancini, A., Zingaretti, P.: Feature group matching for appearance-based localization. In: IEEE/RSJ 2008 International Conference on Intelligent RObots and Systems—IROS 2008, Nice, pp. 3933–3938 (2008)

    Google Scholar 

  2. Desai, C., Ramanan, D., Fowlkes, C.: Discriminative models for multi-class object layout. In: International Conference on Computer Vision IEEE/ICCV, pp. 229–236 (2009)

    Google Scholar 

  3. Ferrari, V., Marin-Jimenez, M., Zisserman, A.: Pose search: retrieving people using their pose. In: International Conference on Computer Vision and Pattern recognition IEEE/CVPR, pp. 1–8 (2009)

    Google Scholar 

  4. Brox, T., Bourdev, L., Maji, S., Malik, J.: Object segmentation by alignment of poselet activations to image contours. In: International Conference on Computer Vision and Pattern recognition IEEE/CVPR, pp. 2225–2232 (2011)

    Google Scholar 

  5. Desai, C., Ramanan, D., Fowlkes., C.: Discriminative models for static human-object interactions. In: Computer Vision and Pattern Recognition Workshops (IEEE/CVPRW), pp. 9–16 (2010)

    Google Scholar 

  6. Farhadi, A., Endres, I., Hoiem, D., Forsyth, D.: Describing objects by their attributes. In: International Computer on Vision and Pattern Recognition, IEEE/CVPR, pp. 1778–1785 (2009)

    Google Scholar 

  7. Moeslund, T.B., Hilton, A., Kruger, V.: A survey of advances in vision-based human motion capture and analysis. Comput. Vis. Image Underst. 104(2–3), 90–126 (2006)

    Article  Google Scholar 

  8. Zhang, J., Marszalek, M., Lazebnik, S., Schmid, C.: Local features and kernels for classification of texture and object categories: a comprehensive study. In: International Conference on Computer Vision and Pattern Recognition Workshop, pp. 13–20 (2006)

    Google Scholar 

  9. Bourdev, L., Malik., J.: Poselets: body part detectors trained using 3D human pose annotations. In: International Conference on Computer Vision IEEE/ICCV, pp. 1365–1372 (2009)

    Google Scholar 

  10. Csurka, G., Bray, C., Dance, C., Fan, L.: Visual categorization with bags of keypoints. In: Workshop on Statistical Learning in Computer Vision, ECCV, pp. 1–22 (2004)

    Google Scholar 

  11. Felzenszwalb, P., Girshick, R., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part based models. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1627–1645 (2010)

    Article  Google Scholar 

  12. Gupta, A., Kembhavi, A., Davis, L.: Observing human-object interactions: using spatial and functional compatibility for recognition. IEEE Trans. Pattern Anal. Mach. Intell. 31(10), 1775–1789 (2009)

    Article  Google Scholar 

  13. Johnson, S., Everingham, M.: Learning effective human pose estimation from inaccurate annotation. In: International Conference on Computer Vision and Pattern recognition IEEE/CVPR, pp. 1465–1472 (2011)

    Google Scholar 

  14. Lampert, C., Nickisch, H., Harmeling, S.: Learning to detect unseen object classes by between-class attribute transfer. In: International Conference on Computer Vision and Pattern recognition IEEE/CVPR, pp. 951–958 (2009)

    Google Scholar 

  15. Laptev, I., Marszałek, M., Schmid, C., Rozenfeld, B.: Learning realistic human actions from movies. In: International Conference on Computer Vision and Pattern recognition IEEE/CVPR, pp. 1–8 (2008)

    Google Scholar 

  16. Lazebnik, S., Schmid, C., Ponce. J.: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: International Conference on Computer Vision and Pattern recognition IEEE/CVPR, pp. 2169–2178 (2006)

    Google Scholar 

  17. Li, L., Su, H., Xing, E., Fei-Fei, L.: Object bank: a high-level image representation for scene classification and semantic feature sparsification. In: Neural Information Processing Systems NIPS, pp. 1378–1386 (2010)

    Google Scholar 

  18. Maji, S., Bourdev, L., Malik, J.: Action recognition from a distributed representation of pose and appearance. In: International Conference on Computer Vision and Pattern recognition IEEE/CVPR, pp. 3177–3184 (2011)

    Google Scholar 

  19. Yao, B., Fei-Fei, L.: Grouplet: a structured image representation for recognizing human and object interactions. In: International Conference on Computer Vision and Pattern recognition IEEE/CVPR, pp. 9–16 (2010)

    Google Scholar 

  20. Yao, B., Fei-Fei, L.: Modeling mutual context of object and human pose in human-object interaction activities. In: International Conference on Computer Vision and Pattern recognition IEEE/CVPR, pp. 17–24 (2010)

    Google Scholar 

  21. Frontoni, E., Raspa, P., Mancini, A., Zingaretti, P., Placidi, V.: Customers’ activity recognition in intelligent retail environments. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) LNCS, vol. 8158, pp. 509–516 (2013)

    Google Scholar 

  22. Frontoni, E., Raspa, P., Mancini, A., Zingaretti, P., Placidi, V.: Smart vision system for shelf analisys in intelligent retail environments. In: ASME/IEEE International Conference on Mechatronic and Embedded Systems and Applications (MESA2013), Portland, Oregon (2013)

    Google Scholar 

  23. Catani, L., Frontoni, E., Zingaretti, P., Di Pasquale, G.: Efficient traffic simulation using busses as active sensor network. In: Proceedings of the ASME Design Engineering Technical Conference (MESA 2011), pp. 889–894 (2011)

    Google Scholar 

  24. Catani, L., Frontoni, E., Zingaretti, P.: A framework based on vision sensors for the automatic management of exchange parking areas. In: IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications (MESA 2010)

    Google Scholar 

Download references

Acknowledgments

Authors would like to thank Daniele Liciotti for his support. This work is partially supported by INRCA and Marche Region in the HDOMO 2.0 project.

Author information

Authors and Affiliations

  1. Dipartimento di Ingegneria dell’Informazione, Università Politecnica delle Marche, Ancona, Italy

    Emanuele Frontoni, Adriano Mancini & Primo Zingaretti

Authors
  1. Emanuele Frontoni
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Adriano Mancini
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Primo Zingaretti
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Emanuele Frontoni .

Editor information

Editors and Affiliations

  1. Università Politecnica delle Marche, Ancona, Italy

    Sauro Longhi

  2. Inst for Microelectronics & Microsystems IMM-CNR, Lecce, Lecce, Italy

    Pietro Siciliano

  3. Industrial Engineering, Università Politecnica delle Marche, Ancona, Italy

    Michele Germani

  4. Information Engineering, Università Politecnica delle Marche, Ancona, Italy

    Andrea Monteriù

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Frontoni, E., Mancini, A., Zingaretti, P. (2014). RGBD Sensors for Human Activity Detection in AAL Environments. In: Longhi, S., Siciliano, P., Germani, M., Monteriù, A. (eds) Ambient Assisted Living. Springer, Cham. https://doi.org/10.1007/978-3-319-01119-6_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-01119-6_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-01118-9

  • Online ISBN: 978-3-319-01119-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation