Skip to main content
SpringerLink
Log in

Human Detection and Tracking

  • Living reference work entry
  • First Online:
Encyclopedia of Robotics

Synonyms

Person/people detection and tracking

Definition

The act of observing and estimating human locomotion with one or more robot sensors.

Overview

In robotics, detecting and tracking moving objects is key to implementing useful and safe robot behaviors. Identifying which of the detected objects are humans is particularly important for domestic and public environments. Typically the robot is required to collect environmental data of the surrounding area using its onboard sensors, estimating where humans are and where they are going to. Moreover, robots should detect and track humans accurately and as early as possible in order to have enough time to react accordingly.

The following sections present the topic from different perspectives, analyzing the two complementary problems of human detection and trackingseparately and differentiating various techniques by the type of sensors and algorithms used for these tasks. In particular, human detection considers the sensors and the...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  • Arras KO, Mozos OM, Burgard W (2007) Using boosted features for the detection of people in 2D range data. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 3402–3407

    Google Scholar 

  • Bar-Shalom Y, Li XR (1995) Multitarget-multisensor tracking: principles and techniques. Y. Bar-Shalom, Storrs

    Google Scholar 

  • Bar-Shalom Y, Li XR, Kirubarajan T (2004) Estimation with applications to tracking and navigation: theory algorithms and software. Wiley, New York

    Google Scholar 

  • Bellotto N, Hu H (2009) Multisensor-based human detection and tracking for mobile service robots. IEEE Trans Syst Man Cybern B Cybern 39(1):167–181

    Google Scholar 

  • Bellotto N, Hu H (2010) Computationally efficient solutions for tracking people with a mobile robot: an experimental evaluation of Bayesian filters. Auton Robot 28(4):425–438

    Google Scholar 

  • Bellotto N, Fernandez-Carmona M, Cosar S (2017) ENRICHME Integration of Ambient Intelligence and Robotics for AAL. In: AAAI Spring Symposium Series.

    Google Scholar 

  • Bennewitz M, Burgard W, Cielniak G, Thrun S (2005) Learning motion patterns of people for compliant robot motion. Int J Robot Res 24(1):31–48

    Google Scholar 

  • Buhmann J, Burgard W, Cremers AB, Fox D, Hofmann T, Schneider FE, Strikos J, Thrun S (1995) The mobile robot RHINO. AI Mag 16(2):31–38

    Google Scholar 

  • Cielniak G, Duckett T, Lilienthal AJ (2010) Data association and occlusion handling for vision-based people tracking by mobile robots. Robot Auton Syst 58(5):435–443

    Google Scholar 

  • Cosgun A, Florencio DA, Christensen HI (2013) Autonomous person following for telepresence robots. In: Proceedings of IEEE international conference on robotics and automation (ICRA), May 2013, pp 4335–4342

    Google Scholar 

  • Dequaire J, Ondrúška P, Rao D, Wang D, Posner I (2017) Deep tracking in the wild: end-to-end tracking using recurrent neural networks. Int J Robot Res 37(4–5): 492–512

    Google Scholar 

  • Dewan A, Caselitz T, Tipaldi GD, Burgard W (2016) Motion-based detection and tracking in 3D LiDAR scans. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 4508–4513

    Google Scholar 

  • Ess A, Leibe B, Schindler K, Van Gool LJ (2009) Moving obstacle detection in highly dynamic scenes. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 56–63

    Google Scholar 

  • Ess A, Schindler K, Leibe B, Van Gool L (2010) Object detection and tracking for autonomous navigation in dynamic environments. Int J Robot Res (IJRR) 29(14):1707–1725

    Google Scholar 

  • Falanga D, Mueggler E, Faessler M, Scaramuzza D (2017) Aggressive quadrotor flight through narrow gaps with onboard sensing and computing using active vision. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 5774–5781

    Google Scholar 

  • Fernández-Caballero A, Castillo JC, Martínez-Cantos J, Martínez-Toms R (2010) Optical flow or image subtraction in human detection from infrared camera on mobile robot. Robot Auton Syst 58(12):1273–1281

    Google Scholar 

  • Germa T, Lerasle F, Ouadah N, Cadenat V (2010) Vision and RFID data fusion for tracking people in crowds by a mobile robot. Comput Vis Image Underst 114(6):641–651

    Google Scholar 

  • Gockley R, Forlizzi J, Simmons R (2007) Natural person-following behavior for social robots. In: 2007 2nd ACM/IEEE international conference on human-robot interaction (HRI), Mar 2007, pp 17–24

    Google Scholar 

  • González A, Villalonga G, Xu J, Vázquez D, Amores J, López AM (2015) Multiview random forest of local experts combining RGB and LIDAR data for pedestrian detection. In: Proceedings of IEEE intelligent vehicles symposium (IV), pp 356–361

    Google Scholar 

  • Gritti AP, Tarabini O, Guzzi J, Di Caro GA, Caglioti V, Gambardella LM, Giusti A (2014) Kinect-based people detection and tracking from small-footprint ground robots. In: Proceedings of the 2014 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 4096–4103

    Google Scholar 

  • Haasch A, Hohenner S, Hüwel S, Kleinehagenbrock M, Lang S, Toptsis I, Fink GA, Fritsch J, Wrede B, Sagerer G (2004) BIRON – the Bielefeld robot companion. In: Prassler E, Lawitzky G, Fiorini P, Hägele M (eds) Proceedings of international workshop on advances in service robotics, pp 27–32. Fraunhofer IRB Verlag, Stuttgart

    Google Scholar 

  • Jafari OH, Mitzel D, Leibe B (2014) Real-time RGB-D based people detection and tracking for mobile robots and head-worn cameras. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 5636–5643

    Google Scholar 

  • Kaestner R, Maye J, Pilat Y, Siegwart R (2012) Generative object detection and tracking in 3D range data. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 3075–3081

    Google Scholar 

  • Kalal Z, Mikolajczyk K, Matas J (2012) Tracking-learning-detection. IEEE Trans Pattern Anal Mach Intell 34:1409–1422

    Google Scholar 

  • Kidono K, Miyasaka T, Watanabe A, Naito T, Miura J (2011) Pedestrian recognition using high-definition LIDAR. In: Proceedings of the 2011 IEEE intelligent vehicles symposium (IV), pp 405–410

    Google Scholar 

  • Kobilarov M, Sukhatme G, Hyams J, Batavia P (2006) People tracking and following with mobile robot using an omnidirectional camera and a laser. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 557–562

    Google Scholar 

  • Li K, Wang X, Xu Y, Wang J (2016) Density enhancement-based long-range pedestrian detection using 3-D range data. IEEE Trans Intell Transp Syst 17:1368–1380

    Google Scholar 

  • Linder T, Arras KO (2014) Multi-model hypothesis tracking of groups of people in RGB-D data. In: 17th international conference on information fusion (FUSION), pp 1–7

    Google Scholar 

  • Linder T, Breuers S, Leibe B, Arras KO (2016) On multi-modal people tracking from mobile platforms in very crowded and dynamic environments. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 5512–5519

    Google Scholar 

  • Montabone S, Soto A (2010) Human detection using a mobile platform and novel features derived from a visual saliency mechanism. Image Vis Comput 28(3):391–402

    Google Scholar 

  • Munaro M, Menegatti E (2014) Fast RGB-D people tracking for service robots. Auton Robot 37:227–242

    Google Scholar 

  • Navarro-Serment LE, Mertz C, Hebert M (2010) Pedestrian detection and tracking using three-dimensional ladar data. Int J Robot Res 29(12):1516–1528

    Google Scholar 

  • Premebida C, Carreira J, Batista J, Nunes U (2014) Pedestrian detection combining RGB and dense LIDAR data. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 4112–4117

    Google Scholar 

  • Ristic B, Arulampalam S, Gordon N (2004) Beyond the Kalman filter: particle filters for tracking applications. Artech House, Boston

    Google Scholar 

  • Schroeter C, Mueller S, Volkhardt M, Einhorn E, Huijnen C, van den Heuvel H, van Berlo A, Bley A, Gross HM (2013) Realization and user evaluation of a companion robot for people with mild cognitive impairments. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 1153–1159

    Google Scholar 

  • Schulz D, Burgard W, Fox D, Cremers AB (2003) People tracking with mobile robots using sample-based joint probabilistic data association filters. Int J Robot Res 22(2):99–116

    Google Scholar 

  • Spinello L, Arras KO (2011) People detection in RGB-D data. In: Proceedings of the 2011 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 3838–3843

    Google Scholar 

  • Spinello L, Luber M, Arras KO (2011) Tracking people in 3D using a bottom-up top-down detector. In: Proceedings of the 2011 IEEE international conference on robotics and automation (ICRA), pp 1304–1310

    Google Scholar 

  • Stone LD, Barlow CA, Corwin TL (1999) Bayesian multiple target tracking. Artech House Publishers, Boston

    Google Scholar 

  • Teichman A, Levinson J, Thrun S (2011) Towards 3D object recognition via classification of arbitrary object tracks. In: Proceedings of the 2011 IEEE international conference on robotics and automation (ICRA), pp 4034–4041

    Google Scholar 

  • Topp EA, Christensen HI (2005) Tracking for following and passing persons. In: 2005 IEEE/RSJ international conference on intelligent robots and systems, pp 2321–2327

    Google Scholar 

  • Treptow A, Cielniak G, Duckett T (2006) Real-time people tracking for mobile robots using thermal vision. Robot Auton Syst 54(9):729–739

    Google Scholar 

  • Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154

    Google Scholar 

  • Wang CC, Thorpe C (2002) Simultaneous localization and mapping with detection and tracking of moving objects. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 2918–2924

    Google Scholar 

  • Wang DZ, Posner I, Newman P (2015) Model-free detection and tracking of dynamic objects with 2D lidar. Int J Robot Res (IJRR) 34(7):1039–1063

    Google Scholar 

  • Yan Z, Duckett T, Bellotto N (2017) Online learning for human classification in 3D lidar-based tracking. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 864–871

    Google Scholar 

  • Zajdel W, Zivkovic Z, Krŏse BJA (2005) Keeping track of humans: have I seen this person before? In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 2093–2098

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Science, University of Lincoln, Lincoln, UK

    Nicola Bellotto & Serhan Cosar

  2. LE2I-CNRS, University of Technology of Belfort-Montbeliard (UTBM), Belfort, France

    Zhi Yan

Authors
  1. Nicola Bellotto
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Serhan Cosar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhi Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nicola Bellotto .

Editor information

Editors and Affiliations

  1. Dept. of Mechanical Engineering Blk 1E Gillman Hts #17-43, National University of Singapore, Singapore, Singapore

    Marcelo H Ang

  2. Department of Computer Science, Stanford University, Stanford, California, USA

    Oussama Khatib

  3. Dipto di Informatica e Sistemistca, Univ di Napoli Federico II, Napoli, Italy

    Bruno Siciliano

Section Editor information

  1. School of Mechanical Engineering, Korea University of Technology & Education, 1600, Chungjeol-ro, Byeongcheon-myeon, Dongnam-gu Cheonan-si, Chungcheongnam-do, 330-708, Cheon-An, Chungcheong, Republic of Korea

    Jee-Hwan Ryu

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer-Verlag GmbH Germany, part of Springer Nature

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Bellotto, N., Cosar, S., Yan, Z. (2018). Human Detection and Tracking. In: Ang, M., Khatib, O., Siciliano, B. (eds) Encyclopedia of Robotics. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41610-1_34-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-41610-1_34-1

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-41610-1

  • Online ISBN: 978-3-642-41610-1

  • eBook Packages: Springer Reference EngineeringReference Module Computer Science and Engineering

Publish with us

Policies and ethics

Search

Navigation