Skip to main content

New Eye Contact Correction Using Radial Basis Function for Wide Baseline Videoconference System

  • Conference paper
Advances in Multimedia Information Processing – PCM 2012 (PCM 2012)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7674))

Included in the following conference series:

Abstract

In this paper, we introduce a novel eye contact correction method for videoconference systems with wide baseline. In this system, assistant cameras are installed on each side of the monitor to help capture the views from left side and right side. A pattern with random dots and Radial Basis Function (RBF) interpolation are used to help create precise disparity maps that is then used for re-projection. The interpolated views show a smooth transit among cameras on two sides. The experimental results also demonstrate that the proposed method could be extended to produce more robust and accurate disparity maps than most of the existing algorithms from regular stereo images.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ott, M., Lewis, J., Cox, I.: Teleconferencing Eye Contact Using a Virtual Camera. In: INTERCHI, pp. 119–110 (1993)

    Google Scholar 

  2. Lei, B.J., Hendriks, E.A.: Real-time Multi-step View Reconstruction for a Virtual Teleconference System. Journal on Applied Signal Processing 2002, 1067–1087 (2002)

    Article  MATH  Google Scholar 

  3. Schreer, O., Hendriks, E., Schraagen, J., Stone, J., Trucco, E., Jewell, M.: Virtual Team User Environment – A Key Application in Telecommunication. In: Proceeding of eBusiness and eWork, Prague, pp. 916–923 (2002)

    Google Scholar 

  4. Baker, H.H., Tanguay, D., Sobel, I., Gelb, D., Goss, M.E., Culbertson, W.B., Malzbender, T.: The Coliseum Immersive Teleconferencing System. In: Proceedings of International Workshop on Immersive Telepresence (2002)

    Google Scholar 

  5. Scharstein, D., Szeliski, R.: A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms. International Journal of Computer Vision 47(1), 7–42 (2002)

    Article  MATH  Google Scholar 

  6. http://vision.middlebury.edu/stereo/eval/

  7. Tao, H., Sawhney, H.S., Kumar, R.: A Global Matching Framework for Stereo Computation. In: Proceedings of ICCV, vol. 1, pp. 532–539 (2001)

    Google Scholar 

  8. Hong, L., Chen, G.: Segment-based Stereo Matching Using Graph Cuts. In: Proceedings of CVPR, pp. 74–81 (2004)

    Google Scholar 

  9. Chen, Y., Quan, L.: Region – Based Progressive Stereo Matching. In: Proceedings of CVPR, pp. 106–113 (2004)

    Google Scholar 

  10. Klaus, A., Sormann, M., Karner, K.: Segment-based Stereo Matching using Belief Propagation and a Self-adapting Dissimilarity Measure. In: Proceedings of CVPR, pp. 15–18 (2006)

    Google Scholar 

  11. Wang, Z., Zheng, Z.: A Region based Stereo Matching Algorithm using Cooperation optimization. In: Proceedings of International Conference on Pattern Recognition, pp. 1–8 (2008)

    Google Scholar 

  12. Yang, Q., Wang, L., Yang, R., Stewenius, H., Nister, D.: Stereo Matching with Color-weighted Correlation, Hierarchical Belief Propagation and Occlusion Handling. In: Proceedings of International Conference on Pattern Recognition, pp. 347–354 (2006)

    Google Scholar 

  13. Carr, J.C., Beatson, R.K., Cherrie, J.B., Mitchell, T.J., Fright, W.R., McCallum, B.C., Evans, T.R.: Reconstruction and Representation of 3D Objects with Radial Basis Functions. In: Proceesings of ACM SIGGRAPH, pp. 67–76 (2001)

    Google Scholar 

  14. Labatut, P., Pons, J.P., Keriven, R.: Robust and Efficient Surface Reconstruction from Range Data. Computer Graphics Forum, 2275–2290 (2009)

    Google Scholar 

  15. Fua, P.: A parallel stereo algorithm that produces dense depth maps and preserves image features. Machine Vision and Applications 6(1), 35–49 (1993)

    Article  Google Scholar 

  16. Comaniciu, D., Meer, P.: Robust Analysis of Feature Spaces: Color Image Segmentation. In: Proceedings of CVPR, pp. 750–755 (1997)

    Google Scholar 

  17. Min, K., Chun, J.: Image-Based 3D Face Modeling from Stereo Images. In: Gavrilova, M.L., Gervasi, O., Kumar, V., Tan, C.J.K., Taniar, D., Laganá, A., Mun, Y., Choo, H. (eds.) ICCSA 2006. LNCS, vol. 3980, pp. 410–419. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  18. de Araujo, A.D.G., Doria Neto, A.D., de Medeiros Martins, A.: Stereo Map Surface Calculus Optimization Using Radial Basis Functions Neural Network Interpolation. In: Leung, C.S., Lee, M., Chan, J.H. (eds.) ICONIP 2009, Part I. LNCS, vol. 5863, pp. 229–236. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  19. Carr, J.C., Fright, W.R., Beatson, R.K.: Surface Interpolation with Radial Basis Functions for Medical Imaging. IEEE Transactions on Medical Imaging 16, 96–107 (1997)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zhou, X., Boulanger, P. (2012). New Eye Contact Correction Using Radial Basis Function for Wide Baseline Videoconference System. In: Lin, W., et al. Advances in Multimedia Information Processing – PCM 2012. PCM 2012. Lecture Notes in Computer Science, vol 7674. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34778-8_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-34778-8_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-34777-1

  • Online ISBN: 978-3-642-34778-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics