Skip to main content

An Overview of Distributed Tracking and Control in Camera Networks

  • Chapter
  • First Online:
Wide Area Surveillance

Part of the book series: Augmented Vision and Reality ((Augment Vis Real,volume 6))

Abstract

In many applications, the information from all the cameras are transmitted to a centralized processing unit. However, for larger networks, centralized schemes can be unscalable and they also exhibit the risk of having a single point of failure. These are some of the many reasons why distributed schemes are being chosen over centralized schemes in various applications nowadays. This chapter provides a comprehensive overview of state-of-the-art distributed tracking and control strategies using a camera network and identifies the main directions of future work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    For this section, we assume that all cameras in the network possess a single consensus state estimate \(\bar{\bf x}^{j-}(k)\) for target \(T^j\) with consensus covariance matrix \({\bf P}^{j-}\).

  2. 2.

    Note that the same properties apply to the local imaging utility represented by \(U_{I_i}(\cdot)\)

References

  1. Olfati-Saber, R.: Kalman-consensus filter Optimality, stability, and performance. In: IEEE Conference on Decision and Control (2009)

    Google Scholar 

  2. Kamal, A.T., Ding, C., Song, B., Farrell, J.A., Roy-Chowdhury, A.K.: A generalized Kalman consensus filter for wide-area video networks. In: IEEE Conference on Decision and Control (2011)

    Google Scholar 

  3. Kamal, A.T., Farrell, J.A., Roy-Chowdhury, A.K.: Information weighted consensus. In: IEEE Conference on Decision and Control (2012)

    Google Scholar 

  4. Ding, C., Song, B., Morye, A.A., Farrell, J.A., Roy-Chowdhury, A.K.: Collaborative sensing in a distributed PTZ camera network. IEEE Trans. Image Process 21(7), 3282–3295 (2012)

    Article  MathSciNet  Google Scholar 

  5. Davis, J.W.: Camera control and geo-registration for video. In: Bhanu, B., Ravishankar, C., Roy-Chowdhury, A.K., Aghajan, H., Terzopoulos, D. (eds.) Distributed Video Sensor Networks. Springer, Berlin (2011)

    Google Scholar 

  6. Markis, D., Ellis, T., Black, J.: Bridging the gap between cameras. In: IEEE Conference on Computer Vision and Pattern Recognition (2004)

    Google Scholar 

  7. Tieu, K., Dalley, G., Grimson, W.E.L.: Inference of non-overlapping camera network topology by measuring statistical dependence. In: IEEE International Conference on Computer Vision (2005)

    Google Scholar 

  8. Song, B., Roy-Chowdhury, A.K.: Stochastic adaptive tracking in a camera network. In: IEEE International Conference on Computer Vision (2007)

    Google Scholar 

  9. Rahimi, A., Darrell, T.: Simultaneous calibration and tracking with a network of non-overlapping sensors. In: IEEE Conference on Computer Vision and Pattern Recognition (2004)

    Google Scholar 

  10. Khan, S., Javed, O., Rasheed, Z., Shah, M.: Human tracking in multiple cameras. In: IEEE International Conference on Computer Vision, vol. 1, pp. 331–336 (2001)

    Google Scholar 

  11. Alahi, A., Marimon, D., Bierlaire, M., Kunt, M.: A master-slave approach for object detection and matching with fixed and mobile cameras. In: International Conference on Image Processing (2008)

    Google Scholar 

  12. Ermis, E., Saligrama, V., Jodoin, P., Konrad, J.: Abnormal behavior detection and behavior matching for networked cameras. In: IEEE/ACM International Conference on Distributed Smart Cameras (2008)

    Google Scholar 

  13. Javed, O., Khan, S., Rasheed, Z., Shah, M.: Camera handoff: tracking in multiple uncalibrated stationary cameras. In: IEEE Workshop on Human Motion, Dec. 2000

    Google Scholar 

  14. Li, Y., Bhanu, B.: Utility based dynamic camera assignment and hand-off in a video network. In: IEEE/ACM International Conference on Distributed Smart Cameras (2008)

    Google Scholar 

  15. Stancil, B., Zhang, C., Chen, T.: Active multicamera networks: from rendering to surveillance. IEEE J. Sel. Top. Signal Process. (Special Issue Distrib. Process. Vis. Netw.) 2, 597–605 (2008)

    Google Scholar 

  16. Zhao, J., Cheung, S.C., Nguyen, T.: Optimal camera network configurations for visual tagging. IEEE J. Sel. Top. Signal Process. 2(4), 464–479 (2008)

    Google Scholar 

  17. Erdem, U.M., Sclaroff, S.: Automated camera layout to satisfy task-specific and floor plan-specific coverage requirements. Comput. Vis. Image Underst. 103(3), 156–169 (2006)

    Article  Google Scholar 

  18. Du, W., Piater, J.: Multi-camera people tracking by collaborative particle filters and principal axis-based integration. In: Asian Conference on Computer Vision (2007)

    Google Scholar 

  19. Khan, S., Shah, M.: A multiview approach to tracking people in crowded scenes using a planar homography constraint. In: European Conference on Computer Vision (2006)

    Google Scholar 

  20. Devarajan, D., Cheng, Z., Radke, R.J.: Calibrating distributed camera networks. Proc. IEEE (Special Issue Distrib. Smart Cameras) 96(10), 1625–1639 (2008)

    Google Scholar 

  21. Sankaranarayanan, A.C., Veeraraghavan, A., Chellappa, R.: Object detection tracking and recognition for multiple smart cameras. Proc. IEEE (Special Issue Distrib. Smart Cameras) 96(10), 1606–1624 (2008)

    Google Scholar 

  22. Wu, C., Aghajan, H.: Real-time human pose estimation: a case study in algorithm design for smart camera networks. Proc. IEEE (Special Issue Distrib. Smart Cameras) 96(10), 1715–1732 (2008)

    Google Scholar 

  23. Olfati-Saber, R., Fax, J.A., Murray, R.M.: Consensus and cooperation in networked multi-agent systems. Proc. IEEE 95(1), 215–233 (2007)

    Article  Google Scholar 

  24. Tron, R., Vidal, R.: Distributed algorithms for camera sensor networks. IEEE Signal Process. Mag. 3, 32–45 (2011)

    Google Scholar 

  25. Tron, R., Vidal, R.: Distributed computer vision algorithms through distributed averaging. In: IEEE Conference on Computer Vision and Pattern Recognition (2011)

    Google Scholar 

  26. Kamal, A.T., Farrell, J.A., Roy-Chowdhury, A.: Optimal distributed maximum a posteriori estimation. In: International Conference on Image Processing (2012)

    Google Scholar 

  27. Taj, M., Cavallaro, A.: Distributed and decentralized multicamera tracking. IEEE Signal Process. Mag. 3, 46–58 (2011)

    Article  Google Scholar 

  28. Song, B., Kamal, A.T., Soto, C., Ding, C., Farrell, J.A., Roy-Chowdhury, A.K.: Tracking and activity recognition through consensus in distribution camera network. IEEE Trans. Image Process. 19(10), 2564–2579 (2010)

    Article  MathSciNet  Google Scholar 

  29. Kamal, A.T., Song, B., Roy-Chowdhury, A.K.: Belief consensus for distributed action recognition. In: International Conference on Image Processing, pp. 141–144, Sept. 2011

    Google Scholar 

  30. Song, B., Ding, C., Kamal, A.T., Farrell, J.A., Roy-Chowdhury, A.K.: Distributed camera networks: integrated sensing and analysis for wide area scene understanding. IEEE Signal Process. Mag. 3, 20–31 (2011)

    Google Scholar 

  31. Micheloni, C., Rinner, B., Foresti, G.L.: Video analysis in Pan-Tilt-Zoom camera networks. IEEE Signal Process. Mag. 27(5), 78–90 (2010)

    Article  Google Scholar 

  32. Micheloni, C., Foresti, G., Snidaro, L.: A network of cooperative cameras for visual-surveillance. IEE Proc. Visual Image Signal Process. 152(2), 205–212 (2005)

    Article  Google Scholar 

  33. Qureshi, F.Z., Terzopoulos, D.: Surveillance in virtual reality: system design and multi-camera control. In: IEEE Conference on Computer Vision and Pattern Recognition (2007)

    Google Scholar 

  34. Arslan, G., Marden, J., Shamma, J.: Autonomous vehicle-target assignment: a game-theoretical formulation. ASME J. Dyn. Syst. Meas. Control 129(5), 584–596 (2007)

    Google Scholar 

  35. Song, B., Soto, C., Roy-Chowdhury, A.K., Farrell, J.A.: Decentralized camera network control using game theory. In: Workshop on Smart Camera and Visual Sensor Networks at ICDSC (2008)

    Google Scholar 

  36. Soto, C., Song, B., Roy-Chowdhury, A.K.: Distributed multi-target tracking in a self-configuring camera network. In: IEEE Conference on Computer Vision and Pattern Recognition (2009)

    Google Scholar 

  37. Ding, C., Morye, A.A., Farrell, J.A., Roy-Chowdhury, A.K.: Coordinated sensing and tracking for mobile camera platforms. In: American Control Conference (2012)

    Google Scholar 

  38. Morye, A.A., Ding, C., Song, B., Roy-Chowdhury, A.K., Farrell, J.A.: Optimized imaging and target tracking within a distributed camera network. In: American Control Conference (2011)

    Google Scholar 

  39. Blake, A., Yuille, A. (eds): Active Vision. MIT Press, Cambridge (1992)

    Google Scholar 

  40. Gu, G., Chandler, R., Schumacher, C., Sparks, A., Pachter, M.: Optimum cooperative UAV sensing based on Cramer-Rao bound. In: American Control Conference, June 2005)

    Google Scholar 

  41. Frew, E.W.: Sensitivity of cooperative geolocalization to orbit coordination. In: AIAA Guidance, Navigation, and Control Conference, Hilton Head, SC, Aug. 2007

    Google Scholar 

  42. Kingston, D.B.: Decentralized control of multiple UAVs for perimeter and target surveillance. Ph.D. Dissertation, Brigham Young University, Provo, Utah, Dec. 2007

    Google Scholar 

  43. Quintero, S., Papi, F., Klein, D., Chisci, L., Hespanha, J.: Optimal UAV coordination for target tracking using dynamic programming. In: IEEE Conference on Decision and Control, Dec. 2010

    Google Scholar 

  44. Stachura, M., Carfang, A., Frew, E.W.: Cooperative target tracking with a communication limited active sensor network. In: International Workshop on Robotic Wireless Sensor Networks (2009)

    Google Scholar 

  45. Olfati-Saber, R., Murray, R.M.: Consensus problems in networks of agents with switching topology and time-delays. IEEE Trans. Autom. Control 49(9), 1520–1533 (2004)

    Article  MathSciNet  Google Scholar 

  46. Moreau, L.: Stability of multiagent systems with time-dependent communication links. IEEE Trans. Autom. Control 50(2), 169–182 (2005)

    Article  MathSciNet  Google Scholar 

  47. Chen, Y., Tron, R., Terzis, A., Vidal, R.: Corrective consensus: converging to the exact average. In: IEEE Conference on Decision and Control, pp. 1221–1228, Dec. 2010

    Google Scholar 

  48. Olfati-Saber, R., Sandell, N.F.: Distributed tracking in sensor networks with limited sensing range. In: Proceedings of the American Control Conference, Seattle, WA, USA, pp. 3157–3162, June 2008

    Google Scholar 

  49. Ren, W., Beard, A.W., Kingston, D.B.: Multi-agent Kalman consensus with relative uncertainty. In: American Control Conference (2005)

    Google Scholar 

  50. Alighanbari, M., How, J.P.: An unbiased Kalman consensus algorithm. In: American Control Conference (2006)

    Google Scholar 

  51. Kalman, R.: A new approach to linear filtering and prediction problems. Trans. ASME (J. Basic Eng.) 82(Series D), 35–45 (1960)

    Google Scholar 

  52. Marden, J., Arslan, G., Shamma, J.: Cooperative control and potential games. IEEE Trans. Syst. Man Cybern. Part B: Cybernet. 39(6), 1393–1407 (2009)

    Google Scholar 

  53. Monderer, D., Shapley, L.S.: Potential games. Games Econ. Behav. 14(1), 124–143 (1996)

    Google Scholar 

  54. Wolpert, D., Tumor, K.: A survey of collectives, In: Tumer, K., Wolpert, D. (eds.) Collectives and the Design of Complex Systems. Springer, New York (2004)

    Google Scholar 

  55. Young, H.P.: Individual Strategy and Social Structure: An Evolutionary Theory of Institutions. Princeton University Press, Princeton (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Amit K. Roy-Chowdhury .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Kamal, A.T., Ding, C., Morye, A.A., Farrell, J.A., Roy-Chowdhury, A.K. (2014). An Overview of Distributed Tracking and Control in Camera Networks. In: Asari, V. (eds) Wide Area Surveillance. Augmented Vision and Reality, vol 6. Springer, Berlin, Heidelberg. https://doi.org/10.1007/8612_2012_10

Download citation

  • DOI: https://doi.org/10.1007/8612_2012_10

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-37840-9

  • Online ISBN: 978-3-642-37841-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics