Skip to main content

Consistent Human Tracking Over Self-organized and Scalable Multiple-camera Networks

  • Chapter
  • First Online:
Distributed Embedded Smart Cameras

Abstract

In this chapter, a self-organized and scalable multiple-camera tracking system that tracks human across the cameras with nonoverlapping views is introduced. Given the GPS locations of uncalibrated cameras, the system automatically detects the existence of camera link relationships within the camera network based on the routing information provided by Google Maps. The connected zones in any pair of directly-connected cameras are identified based on the feature matching between the camera’s view and Google Street View. To overcome the adverse issues of nonoverlapping field of views among cameras, we propose an unsupervised learning scheme to build the camera link model, including transition time distribution, brightness transfer function, region mapping matrix, region matching weights, and feature fusion weights. Our unsupervised learning scheme tolerates well the presence of outliers in the training data and the learned camera link model can be continuously updated even after the tracking is started. The systematic integration of multiple features enables us to perform an effective re-identification across cameras. The pairwise learning and tracking manner also enhances the scalability of the system. Thanks to the unsupervised pairwise learning and tracking in our system, the camera network is self-organized, and our proposed system is able to be scale up efficiently when more cameras are added into the network. Thanks to the unsupervised pairwise learning and tracking in our system, the camera network is self-organized, and our proposed system is able to scale up efficiently when more cameras are added into the network.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://developers.google.com/maps/documentation/streetview/.

References

  1. Farenzena M, Bazzani L, Perina A, Murino V, Cristani M (2010) Person re-identification by symmetry-driven accumulation of local features. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 2360–2367

    Google Scholar 

  2. Gheissari N, Sebastian TB, Tu PH, Rittscher J, Hartley R (2006) Person reidentification using spatiotemporal appearance. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 1528–1535

    Google Scholar 

  3. Gray D, Tao H (2008) Viewpoint invariant pedestrian recognition with an ensamble of localize features. In: Proceedings of ECCV, pp 262–275

    Google Scholar 

  4. Bauml M, Stiefelhagen R (2011) Evaluation of local features for person re-identification in image sequences. In: IEEE international conference on advanced video and signal based surveillance

    Google Scholar 

  5. Zhang Y, Li S (2011) Gabor-LBP based region covariance desciptor for person rei-identification. In: IEEE international conference on image and graphics, pp 368–371

    Google Scholar 

  6. Jungling K, Arens M (2011) View-invariant person re-identification with an implicit shape model. In: IEEE international conference on advanced video and signal based surveillance, pp 197–202

    Google Scholar 

  7. Bak S, Corvee E, Bremond F, Thonnat M (2010) Person re-identification using Haar-based and DCD-based signature. In: IEEE international conference on advanced video and signal based surveillance

    Google Scholar 

  8. Chu C, Hwang J, Yu J, Lee K (2012) Tracking across nonoverlapping cameras based on the unsupervised learning of camera link models. In: ACM/IEEE international conference on distributed smart cameras

    Google Scholar 

  9. D’Orazio T, Mazzeo P, Spagnolo P (2009) Color brightness transfer function evaluation for non overlapping multi camera tracking. In: ACM/IEEE international conference on distributed smart cameras, pp 1–6

    Google Scholar 

  10. Prosser B, Gong S, Xiang T (2008) Multi-camera matching using bi-directional cumulative brightness transfer functions. In: British machine vision conference

    Google Scholar 

  11. Javed O, Rasheed Z, Shafique K, Shah M (2003) Tracking across multiple cameras with disjoint views. In: Proceedings of IEEE conference on computer vision, pp 952–957

    Google Scholar 

  12. Javed O, Shafique K, Rasheed Z, Shah M (2008) Modeling inter-camera space-time and appearance relationships for tracking across non-overlapping views. Comput Vis Image Underst 109(2):146–162

    Google Scholar 

  13. Chu C, Hwang J, Wang S, Chen Y (2011) Human tracking by adaptive Kalman filtering and multiple kernels tracking with projected gradients. In: ACM/IEEE international conference on distributed smart cameras

    Google Scholar 

  14. Makris D, Ellis T, Black J (2004) Bridging the gaps between cameras. In: Proceedings of the IEEE conference on computer vision and pattern recognition, vol 2, pp 205–210

    Google Scholar 

  15. Tieu K, Dalley G, Grimson W (2004) Inference of non-overlapping camera network topology by measuring statistical dependence. In: Proceedings of the IEEE conference on computer vision, vol 2, pp 1842–1849

    Google Scholar 

  16. Gilbert A, Bowden R (2006) Tracking objects across cameras by incrementally learning inter-camera colour calibration and patterns of activity. In: Proceedings of ECCV, pp 125–136

    Google Scholar 

  17. Huang C-C, Chiu W-C, Wang S-J, Chang J-H (2010) Probabilistic modeling of dynamic traffic flow across non-overlapping camera views. In: IEEE international conference on pattern recognition, pp 3332–3335

    Google Scholar 

  18. Wang X,Tieu K, Grimson W (2005) Correspondnece-free activity analysis and scene modeling in multiple camera views. IEEE Trans Pattern Anal Mach Intell 32:56–71

    Google Scholar 

  19. Chu C, Hwang J, Chen Y, Wang S (2012) Camera link model estimation in a distributed camera network based on the deterministic annealing and the barrier method. In: Proceedings of IEEE conference on ASSP, pp 997–1000

    Google Scholar 

  20. Chu C, Lee K, Hwang J (2013) Self-organized and scalable camera networks for systematic human tracking across nonoverlapping cameras. In: Proceedings of IEEE conference on ASSP

    Google Scholar 

  21. Chu C, Hwang J, Pai H-I, Lan K-M (2013) Tracking human under occlusion based on adaptive multiple kernels with projected gradients. IEEE Trans Multimedia 15(7):1602–1615 Nov

    Article  Google Scholar 

  22. Chen K, Lai C, Lee P, Chen C, Hung Y (2011) Adaptive learning for target tracking and true linking discovering across multiple non-overlapping cameras. IEEE Trans Multimedia 13:625–638

    Article  Google Scholar 

  23. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Intl J Comput Vis 60(2):91–110

    Article  Google Scholar 

  24. Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classificaiton with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    Google Scholar 

  25. Rose K (1998) Deterministic annealing for clustering, compression, classification, regression, and related optimization problems. Proc IEEE 86(11):2210–2239

    Article  Google Scholar 

  26. Boyd S, Vandenberghe L (2004) Ch8.1 in convex optimization. Cambridge University Press, Cambridge

    Google Scholar 

  27. Sinkhorn R (1964) A relationship between arbitrary positive matrices and doubly stochastic matrices. Ann Math Statist 35(2):876–879

    Google Scholar 

  28. Chiu H, Rangarajan A (2003) A new point matching algorithm for non-rigid registration. Comput Vis Image Underst 89:114–141

    Article  Google Scholar 

  29. Maciel J, Costeira J (2003) A global solution to sparse correspondence problems. IEEE Trans Pattern Anal Mach Intell 25(2):187–199

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kuan-Hui Lee .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer Science+Business Media New York

About this chapter

Cite this chapter

Lee, KH., Chu, CT., Lee, Y., Fang, Z., Hwang, JN. (2014). Consistent Human Tracking Over Self-organized and Scalable Multiple-camera Networks. In: Bobda, C., Velipasalar, S. (eds) Distributed Embedded Smart Cameras. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-7705-1_9

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-7705-1_9

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-7704-4

  • Online ISBN: 978-1-4614-7705-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics