Perception-Based Design for Tele-presence

  • Santanu Chaudhury
  • Shantanu Ghosh
  • Amrita Basu
  • Brejesh Lall
  • Sumantra Dutta Roy
  • Lopamudra Choudhury
  • R. Prashanth
  • Ashish Singh
  • Amit Maniyar
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6744)

Abstract

We present a novel perception-driven approach to low-cost tele-presence systems, to support immersive experience in continuity between projected video and conferencing room. We use geometry and spectral correction to impart for perceptual continuity to the whole scene. The geometric correction comes from a learning-based approach to identifying horizontal and vertical surfaces. Our method redraws the projected video to match its vanishing point with that of the conference room in which it is projected. We quantify intuitive concepts such as the depth-of-field using a Gabor filter analysis of overall images of the conference room. We equalise spectral features across the projected video and the conference room, for spectral continuity between the two.

Keywords

Tele-presence Homography Texture Transfer Perceptual Continuity Spectral Correction 

References

  1. 1.
    Criminisi, A., Reid, I., Zisserman, A.: Single View Metrology. International Journal of Computer Vision 40(2), 123–148 (2000)CrossRefMATHGoogle Scholar
  2. 2.
    Faugeras, O.: Three-Dimensional Computer Vision. MIT Press, Cambridge (1993)Google Scholar
  3. 3.
    Hoiem, D., Efros, A.A., Hebert, M.: Automatic Photo Pop-up. In: ACM SIGGRAPH (2005)Google Scholar
  4. 4.
    Irani, M., Rousso, B., Peleg, S.: Computing Occluding and Transparent Motions. International Journal of Computer Vision 12(1), 5–16 (1994)CrossRefGoogle Scholar
  5. 5.
    Oliva, A., Torralba, A.: Modeling the Shape of the scene: A Holistic Representation of the Spatial Envelope. International Journal of Computer Vision 42(3), 145–175 (2001)CrossRefMATHGoogle Scholar
  6. 6.
    Ralph Algazi, V., Duda, R.O.: Headphone-Based Spatial Sound. IEEE Signal Processing Magazine, 33–42 (2011)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Santanu Chaudhury
    • 1
  • Shantanu Ghosh
    • 1
    • 2
  • Amrita Basu
    • 3
  • Brejesh Lall
    • 1
  • Sumantra Dutta Roy
    • 1
  • Lopamudra Choudhury
    • 3
  • R. Prashanth
    • 1
  • Ashish Singh
    • 1
  • Amit Maniyar
    • 1
  1. 1.Multimedia Lab, Department of Electrical EngineeringIndian Institute of Technology DelhiNew DelhiIndia
  2. 2.Behavioural & Cognitive Science Lab, Department of Humanities & Social SciencesIndian Institute of Technology DelhiNew DelhiIndia
  3. 3.School of Cognitive SciencesJadavpur UniversityKolkataIndia

Personalised recommendations