Skip to main content
SpringerLink
Log in

Multi-valued Images and Their Separation

  • Conference paper
  • First Online:
Multi-Image Analysis

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2032))

Abstract

Consider scenes deteriorated by reflections off a semireflecting medium (e.g., a glass window) that lies between the observer and an object. We present two approaches to recover the superimposed scenes. The first one is based on a focus cue, and can be generalized to volumetric imaging with multiple layers. The second method, based on a polarization cue, can automatically label the reconstructed scenes as reflected/transmitted. It is also demonstrated how to blindly determine the imaging PSF or the orientation of the invisible (semi-reflecting) surface in space in such situations

© IEEE, Kluwer Academic Publishers, and the Optical Society of America. Parts of this paper were reproduced, with permission, from the Proc. Int. Conf. on Computer Vision, Vol. II, p. 814-819 (Kerkyra, 20/Sep/1999); Proc. Conf. on Computer Vision and Pattern Recognition, Vol. I, p. 38-43 (Hilton Head Island, 12/Jun/2000); Int. J. on Computer Vision; and J. Optical Society America A, Vol. 17 p. 276-284 (2000).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Agard, D. A., Sedat, J. W.: Three-dimensional structure of a polytene nucleus. Nature 302 (1983) 676–681.

    Article  Google Scholar 

  2. Aizawa, K., Kodama, K., Kubota, A.: Producing object-based special effects by fusing multiple differently focused images. IEEE Trans. on Circuits and Systems for Video Technology 10 (2000) 323–330.

    Article  Google Scholar 

  3. Bergen, J. R., Burt, P. J., Hingorani, R., Peleg, S.: A three-frame algorithm for estimating two-component image motion. IEEE Trans. Pattern. Anal. Mach. Intell. 14 (1992) 886–895.

    Article  Google Scholar 

  4. Borga, M., Knutsson, H.: Estimating multiple depths in semi-transparent stereo images. Proc. Scandinavian Conf. on Image Analysis Vol. I (1999) 127–133. Kangerlussuaq, Greenland. Published by the Pattern Recognition Society of Denmark, Lyngby, Denmark.

    Google Scholar 

  5. Castleman, K. R.: Digital image processing (1979) 357–360. Prentice-Hall, New Jersey.

    Google Scholar 

  6. Conchello, J. A., Hansen E. W.: Enhanced 3-D reconstruction from confocal scanning microscope images. I: Deterministic and maximum likelihood reconstructions. Applied Optics bf 29 (1990) 3795–3804.

    Google Scholar 

  7. Darrell, T., Simoncelli, E.: ‘Nulling’ filters and the separation of transparent motions. Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (1993) 738–739

    Google Scholar 

  8. Farid H., Adelson, E. H.: Separating reflections from images by use of independent components analysis. J. Opt. Soc. Am. A 16 (1999) 2136–2145.

    Article  Google Scholar 

  9. Irani, M., Rousso, B., Peleg, S.: Computing occluding and transparent motions. Int. J. Comp. Vis. 12 (1994) 5–16.

    Article  Google Scholar 

  10. Kubota, A., Aizawa, K.: Inverse filters for generation of arbitrarily focused images. Proc. SPIE 4067 Visual Communications and Image Processing (2000) 1633–1641.

    Google Scholar 

  11. Marcias-Garza, F., Bovik, A. C., Diller, K. R., Aggarwal, S. J., Aggarwal, J. K.: The missing cone problem and low-pass distortion in optical serial sectioning microscopy. Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing, Vol-II (1988) 890–893.

    Google Scholar 

  12. Ohnishi, N. Kumaki, K., Yamamura T., Tanaka, T.: Separating real and virtual objects from their overlapping images. Proc. European Conf. on Computer Vision Vol. II, Lecture notes in Computer Science 1065 (1996) 636–646.

    Google Scholar 

  13. Oren M., Nayar, S. K.: A theory of specular surface geometry. Proc. IEEE International Conf. on Computer Vision (1995) 740–747

    Google Scholar 

  14. Schechner, Y. Y., Kiryati, N.: Depth from defocus vs. Stereo: How different really are they? Int. J. Computer Vision 39 (2000) 141–162.

    Article  MATH  Google Scholar 

  15. Schechner, Y. Y., Kiryati N., Basri, R.: Separation of transparent layers using focus. Proc. IEEE International Conf. on Computer Vision 1061–1066 (1998) Mumbai, India.

    Google Scholar 

  16. Schechner, Y. Y., Kiryati N., Basri, R.: Separation of transparent layers using focus. International J. on Computer Vision, 39 (2000) 25–39.

    MATH  Google Scholar 

  17. Schechner, Y. Y., Kiryati N., Shamir, J.: Separation of transparent layers by polarization analysis. Proc. Scandinavian Conf. on Image Analysis, Vol. I (1999) 235–242. Published by the Pattern Recognition Society of Denmark, Lyngby, Denmark.

    Google Scholar 

  18. Schechner, Y. Y., Shamir, J., Kiryati, N.: Vision through semireflecting media: Polarization analysis. Optics Letters 24 (1999) 1088–1090.

    Article  Google Scholar 

  19. Schechner, Y. Y., Shamir, J., Kiryati, N.: Polarization-based decorrelation of transparent layers: The inclination angle of of an invisible surface. Proc. IEEE International Conf. on Computer Vision, Vol. II (1999) 814–819.

    Article  Google Scholar 

  20. Schechner, Y. Y., Kiryati, N., Shamir, J.: Blind recovery of transparent and semireflected scenes. Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. I (2000) 38–43

    Google Scholar 

  21. Schechner, Y. Y., Shamir, J., Kiryati, N.: Polarization and statistical analysis of scenes containing a semireflector. J. Opt. Soc. Am. A 17 (2000) 276–284.

    Article  Google Scholar 

  22. Shizawa, M.: On visual ambiguities due to transparency in motion and stereo. Proc. European Conf. on Computer Vision. Lecture notes in Computer Science 588 (1992) 411–419.

    Google Scholar 

  23. Shizawa, M., Mase, K.: Simultaneous multiple optical flow estimation. Proc. International Conference on Pattern Recognition, Vol. 1 (1990) 274–278.

    Article  Google Scholar 

  24. Thevenaz, P., Unser, M.: An efficient mutual information optimizer for multiresolution image registration. Proc. IEEE Computer Society International Conference on Image Processing, Vol. I (1998) 833–837.

    Google Scholar 

  25. Viola, P., Wells, W. M. III: Alignment by maximization of mutual information. Int. J. of Computer Vision 24 (1997) 137–154.

    Article  Google Scholar 

  26. Wang, J. Y. A., Adelson, E. H.: Layered representation for motion analysis. Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition 1993) 361–365.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Columbia University, New York, NY, 10027, USA

    Yoav Y. Schechner

  2. Tel-Aviv University, Ramit Aviv, 69978, Israel

    Nahum Kiryati

  3. Techion - Israel Institute of Technology, Haifa, 32000, Israel

    Joseph Shamir

Authors
  1. Yoav Y. Schechner
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nahum Kiryati
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Joseph Shamir
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Center for image Technology and Robotics (CITR Tamaki), Auckland, New Zealand

    Reinhard Klette  & Georgy Gimel’farb  & 

  2. 2039 Beckman Institute, University of Illinois, 405 N. Mathews, Urbana, IL, 61801, USA

    Thomas Huang

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Schechner, Y.Y., Kiryati, N., Shamir, J. (2001). Multi-valued Images and Their Separation. In: Klette, R., Gimel’farb, G., Huang, T. (eds) Multi-Image Analysis. Lecture Notes in Computer Science, vol 2032. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45134-X_10

Download citation

  • DOI: https://doi.org/10.1007/3-540-45134-X_10

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42122-1

  • Online ISBN: 978-3-540-45134-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation