Abstract
We present a novel color multiplexing method for extracting depth edges in a scene. It has been shown that casting shadows from different light positions provides a simple yet robust cue for extracting depth edges. Instead of flashing a single light source at a time as in conventional methods, our method flashes all light sources simultaneously to reduce the number of captured images. We use a ring light source around a camera and arrange colors on the ring such that the colors form a hue circle. Because complementary colors are arranged at any position and its antipole on the ring, shadow regions where a half of the hue circle is occluded are colorized according to the orientations of depth edges, while non-shadow regions where all the hues are mixed have a neutral color in the captured image. In an ideal situation, the colored shadows in a single image directly provide depth edges and their orientations. In practice, we present a robust depth edge extraction algorithm using an additional image captured by rotating the hue circle with 180°. We demonstrate the advantages of our approach using a camera prototype consisting of a standard camera and 8 color LEDs.
Chapter PDF
Similar content being viewed by others
References
Raskar, R., Tan, K.H., Feris, R., Yu, J., Turk, M.: Non-photorealistic camera: Depth edge detection and stylized rendering using multi-flash imaging. ACM Trans. Graphics 23, 679–688 (2004)
Crispell, D., Lanman, D., Sibley, P.G., Zhao, Y., Taubin, G.: Beyond silhouettes: Surface reconstruction using multi-flash photography. In: 3DPVT, pp. 405–412 (2006)
Feris, R., Raskar, R., Chen, L., Tan, K.H., Turk, M.: Multiflash stereopsis: Depth-edge-preserving stereo with small baseline illumination. IEEE Trans. Pattern Anal. Mach. Intell. 30, 147–159 (2008)
Agrawal, A., Sun, Y., Barnwell, J., Raskar, R.: Vision-guided robot system for picking objects by casting shadows. Int’l J. Robotics Research 29, 155–173 (2010)
Liu, M.Y., Tuzel, O., Veeraraghavan, A., Chellappa, R., Agrawal, A., Okuda, H.: Pose estimation in heavy clutter using a multi-flash camera. In: ICRA, pp. 2028–2035 (2010)
Liu, M.Y., Tuzel, O., Veeraraghavan, A., Taguchi, Y., Marks, T.K., Chellappa, R.: Fast object localization and pose estimation in heavy clutter for robotic bin picking. Int’l J. Robotics Research 31, 951–973 (2012)
Feris, R., Turk, M., Raskar, R.: Dealing with multi-scale depth changes and motion in depth edge detection. In: SIBGRAPI, pp. 3–10 (2006)
Vaquero, D.A., Raskar, R., Feris, R.S., Turk, M.: A projector-camera setup for geometry-invariant frequency demultiplexing. In: CVPR, pp. 2082–2089 (2009)
Chen, C., Vaquero, D., Turk, M.: Illumination demultiplexing from a single image. In: ICCV (2011)
Woodham, R.J.: Photometric method for determining surface orientation from multiple images. Opt. Eng. 19, 139–144 (1980)
Hernandez, C., Vogiatzis, G., Brostow, G.J., Stenger, B., Cipolla, R.: Non-rigid photometric stereo with colored lights. In: ICCV, pp. 1–8 (2007)
De Decker, B., Kautz, J., Mertens, T., Bekaert, P.: Capturing multiple illumination conditions using time and color multiplexing. In: CVPR, pp. 2536–2543 (2009)
Fyffe, G., Yu, X., Debevec, P.: Single-shot photometric stereo by spectral multiplexing. In: ICCP, pp. 1–6 (2011)
Schechner, Y., Nayar, S., Belhumeur, P.: A theory of multiplexed illumination. In: ICCV, vol. 2, pp. 808–815 (2003)
Park, J.I., Lee, M.H., Grossberg, M.D., Nayar, S.K.: Multispectral imaging using multiplexed illumination. In: ICCV (2007)
Sá, A.M., Carvalho, P.C.P., Velho, L.: (b, s)-BCSL: Structured light color boundary coding for 3D photography. In: VMV (2002)
Minomo, Y., Kakehi, Y., Iida, M., Naemura, T.: Transforming your shadow into colorful visual media: Multiprojection of complementary colors. Comput. Entertain. 4 (2006)
MacEvoy, B.: Color vision (2008), http://www.handprint.com/LS/CVS/color.html
Vaquero, D.A., Feris, R.S., Turk, M., Raskar, R.: Characterizing the shadow space of camera-light pairs. In: CVPR (2008)
Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8, 679–698 (1986)
Feris, R., Raskar, R., Tan, K.H., Turk, M.: Specular reflection reduction with multi-flash imaging. In: SIBGRAPI, pp. 316–321 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Taguchi, Y. (2012). Rainbow Flash Camera: Depth Edge Extraction Using Complementary Colors. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7577. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33783-3_37
Download citation
DOI: https://doi.org/10.1007/978-3-642-33783-3_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33782-6
Online ISBN: 978-3-642-33783-3
eBook Packages: Computer ScienceComputer Science (R0)