Shadow Segmentation Using Time-of-Flight Cameras

  • Faisal Mufti
  • Robert Mahony
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6978)


Time-of-flight (TOF) cameras are primarily used for range estimation by illuminating the scene through a TOF infrared source. However, additional background sources of illumination of the scene are also captured in the measurement process. This paper uses radiometric modelling of the signals emitted from the camera and a Lambertian reflectance model to develop a shadow segmentation algorithm. The proposed model is robust and is experimentally verified using real data.


Time-of-flight Radiometric Modelling Shadow Segmentation Reflectance Modelling 


  1. 1.
    Benedek, C., Sziranyi, T.: Bayesian foreground and shadow detection in uncertain frame rate surveillance videos. IEEE Trans. Image Process. 17(4), 608–621 (2008)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Cao, X., Shah, M.: Camera calibration and light source estimation from images with shadows. In: Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition CVPR 2005, vol. 2, pp. 918–923 (2005)Google Scholar
  3. 3.
    Cucchiara, R., Grana, C., Piccardi, M., Prati, A.: Detecting moving objects, ghosts, and shadows in video streams. IEEE Trans. Pattern Anal. Mach. Intell. 25(10), 1337–1342 (2003)CrossRefGoogle Scholar
  4. 4.
    Elgammal, A., Duraiswami, R., Harwood, D., Davis, L.: Background and foreground modeling using nonparametric kernel density estimation for visual surveillance. Proc. IEEE 90(7), 1151–1163 (2002)CrossRefGoogle Scholar
  5. 5.
    Fardi, B., Dousa, J., Wanielik, G., Elias, B., Barke, A.: Obstacle detection and pedestrian recognition using a 3D PMD camera. In: Proc. IEEE Intell. Vehicles Symp., pp. 225–230 (2006)Google Scholar
  6. 6.
    Foley, J.D., Da, A.V., Feiner, S.K., Hughes, J.F.: Computer Graphics: Principles and Practices. Addison-Wesley Publishing Company, Inc., Reading (1997)Google Scholar
  7. 7.
    Forsyth, D.A., Ponce, J.: Computer Vision: A Modern Approach. Prentice-Hall, Englewood Cliffs (2003)Google Scholar
  8. 8.
    Jacques, J., Jung, C., Musse, S.: Background subtraction and shadow detection in grayscale video sequences. In: Proc. 18th Brazilian Symposium on Computer Graphics and Image Processing SIBGRAPI 2005, pp. 189–196 (2005)Google Scholar
  9. 9.
    Kahlmann, T., Remondino, F., Guillaume, S.: Range imaging technology: new developments and applications for people identification and tracking. In: Proc. SPIE-IS&T Electronic Imaging, San Jose, CA, USA, vol. 6491 (January 2007)Google Scholar
  10. 10.
    Klasing, K., Althoff, D., Wollherr, D., Buss, M.: Comparison of surface normal estimation methods for range sensing applications. In: Proc. IEEE International Conference on Robotics and Automation, ICRA 2009, May 12-17, pp. 3206–3211 (2009)Google Scholar
  11. 11.
    Kuhnert, K.D., Stommel, M.: Fusion of stereo-camera and PMD-camera data for real-time suited precise 3D environment reconstruction. In: Proc. IEEE/RSJ Int. Conf. Intell. Robot. Systs. (2006)Google Scholar
  12. 12.
    Lange, R., Seitz, P.: Solid-state time-of-flight range camera. IEEE J. Quantum Electron. 37, 390–397 (2001)CrossRefGoogle Scholar
  13. 13.
    Leroy, M., Roujean, J.L.: Sun and view angle corrections on reflectances derived from NOAA/AVHRR data. IEEE Trans. Geosci. Remote Sens. 32(3), 684–697 (1994)CrossRefGoogle Scholar
  14. 14.
    MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proc. Fifth Berkeley Symp. on Math. Statist. and Prob., vol. 1, pp. 281–297. Univ. of Calif. Press (1967)Google Scholar
  15. 15.
    Meier, E., Ade, F.: Tracking cars in range image sequnces. In: Proc. IEEE Int. Conf. Intell. Trans. Systs., pp. 105–110 (1997)Google Scholar
  16. 16.
    Mufti, F., Mahony, R.: Statistical analysis of measurement processes for time-of-flight cameras. In: Proc. SPIE Videometrics, Range Imaging, and Applications X, vol. 7447-21 (2009)Google Scholar
  17. 17.
    Mufti, F., Mahony, R.: Radiometric range image filtering for time-of-flight cameras. In: Proc. Int. Conf. on Computer Vision Theory and Applications (VISAPP 2010), Angers, France, vol. 1, pp. 143–152 (May 2010)Google Scholar
  18. 18.
    Sillion, F.X., Puech, C.: Radiosity and Global Illumination. Morgan Kaufmann, San Francisco (1994)Google Scholar
  19. 19.
    Tsai, V.: A comparative study on shadow compensation of color aerial images in invariant color models. IEEE Trans. Geosci. Remote Sens. 44(6), 1661–1671 (2006)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Faisal Mufti
    • 1
  • Robert Mahony
    • 2
  1. 1.Center for Advanced Studies in EngineeringPakistan
  2. 2.Australian National UniversityAustralia

Personalised recommendations