Dynamic Scene Reconstruction for 3D Virtual Guidance

  • Alessandro Calbi
  • Lucio Marcenaro
  • Carlo S. Regazzoni
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4252)


In this paper a system is presented able to reproduce the actions of multiple moving objects into a 3D model. A multi-camera system is used for automatically detect, track and classify the objects. Data fusion from multiple sensors allows to get a more precise estimation of the position of detected moving objects and to solve occlusions problem. These data are then used to automatically place and animate objects avatars in a 3D virtual model of the scene, thus allowing users connected to this system to receive a 3D guide into the monitored environment.


Single Camera Ambient Intelligence Dynamic Scene Virtual Camera Multi Camera System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Rodriguez, T., Sturm, P., Gargallo, P., Guilbert, N., Heyden, A., Menendez, J.M., Ronda, J.I.: Photorealistic 3d reconstruction from handheld cameras. Machine Vision and Applications 16(4), 246–257 (2005), Available: CrossRefGoogle Scholar
  2. 2.
    Fiocco, M., Boström, G., Gonçalves, J.G.M., Sequeira, V.: Multisensor fusion for volumetric reconstruction of large outdoor areas. In: 3DIM, pp. 47–54 (2005)Google Scholar
  3. 3.
    Bahadori, S., Iocchi, L.: A stereo vision system for 3d reconstruction and semi-automatic surveillance of museum areas. In: AI*IA 2003: Advances in Artificial Intelligence, 8th Congress of the Italian Association for Artificial Intelligence, Pisa, Italy, Proceedings of Workshop Intelligenza Artificiale per i Beni Cultural, Pisa, Italy, September 23-26 (2003)Google Scholar
  4. 4.
    Sebe, I.O., Hu, J., You, S., Neumann, U.: 3d video surveillance with augmented virtual environments. In: IWVS 2003: First ACM SIGMM international workshop on Video surveillance, pp. 107–112. ACM Press, New York (2003)CrossRefGoogle Scholar
  5. 5.
    Collins, R.T., Biernacki, C., Celeux, G., Lipton, A.J., Govaert, G., Kanade, T.: Introduction to the special section on video surveillance. IEEE Trans. Pattern Anal. Machine Intell. 22(7), 745–746 (2000)CrossRefGoogle Scholar
  6. 6.
    Comaniciu, D., Ramesh, V., Meer, P.: Real-time tracking of non-rigid objects using mean shift. In: CVPR, p. 2142 (2000)Google Scholar
  7. 7.
    Collins, R., Lipton, A., Fujiyoshi, H., Kanade, T.: Algorithms for cooperative multisensor surveillance. Proceedings of the IEEE 89(10), 1456–1477 (2001), [Online]. Available: CrossRefGoogle Scholar
  8. 8.
    Reiss, T.H.: The revised fundamental theorem of moment invariants. IEEE Trans. Pattern Anal. Machine Intell. 13(8), 830–834 (1991)CrossRefGoogle Scholar
  9. 9.
    Piva, S., Calbi, A., Angiati, D., Regazzoni, C.S.: A multi-feature object association framework for overlapped field of view multi-camera video surveillance systems. In: IEEE International Conference on Advanced Video and Signal based Surveillance (AVSS), Como, Italy, September 15-16, pp. 505–510 (2005)Google Scholar
  10. 10.
    Tsai, R.Y.: A versatile camera calibration technique for high-accuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses, pp. 221–244 (1992)Google Scholar
  11. 11.
    Welch, G., Bishop, G.: An introduction to the kalman filter. Chapel Hill, NC, USA, Tech. Rep (1995)Google Scholar
  12. 12.
    Zhao, Y., Taubin, G.: Real-time median filtering for embedded smart cameras. In: ICVS, p. 55. IEEE Computer Society Press, Los Alamitos (2006)Google Scholar
  13. 13.
    The AutoDesk website. [Online]. Available (2006),
  14. 14.
    The Open Scene Graph website [Online] Available (2006),
  15. 15.
    The Cal3D website (2006), [Online] Available
  16. 16.
    The ReplicantBody website (2006), [Online] Available

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Alessandro Calbi
    • 1
  • Lucio Marcenaro
    • 2
  • Carlo S. Regazzoni
    • 1
  1. 1.DIBEUniversity of GenovaGenovaItaly
  2. 2.TechnoAware S.r.lGenovaItaly

Personalised recommendations