Abstract
A real-time trinocular stereo vision processor is proposed which combines a window matching architecture with a classification architecture. A pair wise segmented window matching for both the center-right and center-left image pairs as their scaled down image pairs is performed. The resulting cost functions are combined which results into nine different cost curves. A multi level hierarchical classifier is used to select the most promising disparity value. The classifier makes use of features provided by the calculated cost curves and the pixels’ spatial neighborhood information. Evaluation and classifier training has been performed using an indoor dataset. The system is prototyped on an FPGA board equipped with three CMOS cameras. Special care has been taken to reduce the latency and the memory footprint.
This research has been sponsored in part by the BOF (Bijzonder Onderzoeks Fonds uHasselt), Flanders FWO (Fonds voor Wetenschappelijk Onderzoek) and Chinese MOST (Ministry of Science and Technology) project number G.A.063.10.
Chapter PDF
Similar content being viewed by others
Keywords
References
Mozerov, M., Gonzalez, J., Roca, X., Villanueva, J.J.: Trinocular stereo matching with composite disparity space image. In: 16th IEEE International Conference on Image Processing, Proceedings IEEE ICIP 2009, pp. 2089–2092 (2009)
Ueshiba, T.: An efficient implementation technique of bidirectional matching for real-time trinocular stereo vision. In: 18th International Conference on Pattern Recognition, Proceedings IEEE ICPR 2006, pp. 1076–1079 (2006)
Yoon, K.J., Kweon, I.S.: Adaptive support-weight approach for correspondence search. IEEE Trans. PAMI 28(4), 650–656 (2006)
Motten, A., Claesen, L.: A Binary Adaptable Window SoC Architecture for a Stereo Based Depth Field Processor. In: Proceedings IEEE VLSI-SOC 2010, 18th IEEE/IFIP International Conference on VLSI and System-on-Chip, Madrid, September 27-29, pp. 25–30 (2010)
Hu, X., Mordohai, P.: Evaluation of stereo confidence indoors and outdoors. In: Proceedings IEEE CVPR 2010, 23rd IEEE Conference on Computer Vision and Pattern Recognition, pp. 1466–1473 (2010)
Motten, A., Claesen, L., Pan, Y.: Binary confidence evaluation for a stereo vision based depth field processor SoC. In: Proceedings IEEE ACPR 2011, 1st Asian Conference on Pattern Recognition, Beijing, November 28-30, pp. 456–460 (2011)
Jin, S., Cho, J., Pham, X.D., Lee, K.M., Park, S.-K., Jeon, J.W.: FPGA Design and Implementation of a Real-Time Stereo Vision System. IEEE Transactions on Circuits and Systems for Video Technology 20(1), 15–26 (2010)
Motten, A., Claesen, L.: Low-cost real-time stereo vision hardware with binary confidence metric and disparity refinement. In: Proceedings IEEE ICMT 2011, International Conference on Multimedia Technology, pp. 3559–3562 (2011)
Li , M., Jia, Y.: Stereo vision system on programmable chip (SVSoC) for small robot navigation. In: Proceedings IEEE/RSJ IROS 2006, International Conference on Intelligent Robots and Systems, pp. 1359–1365 (2006)
Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision 47(1), 7–42 (2002)
Scharstein, D., Szeliski, R.: High-accuracy stereo depth maps using structured light. In: Proceedings IEEE CVPR 2003, IEEE Conference on Computer Vision and Pattern Recognition, pp. 195–202 (2003)
Hirschmüller, H., Scharstein, D.: Evaluation of cost functions for stereo matching. In: Proceedings IEEE CVPR 2007, International Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)
Malvar, H., He, L., Cutler, R.: High-Quality Linear Interpolation for Demosaicing of Bayer-Patterned Color Images. In: Proceedings IEEE ICASSP 2004, IEEE International Conference on Acoustics, Speech, and Signal Processing, May 17-21, pp. 485–488 (2004)
Zhang, Z.: Flexible Camera Calibration by Viewing a Plane from Unknown Orientations. In: Proceedings IEEE ICCV 1999, 7th IEEE International Conference on Computer Vision, Kerkyra, September 20-25, pp. 666–673 (1999)
Motten, A., Claesen, L., Pan, Y.: Adaptive Memory Architecture for Real-Time Image Warping. In: Proceedings IEEE ICCD 2010, 30th IEEE International Conference on Computer Design, Montreal, September 30-October 3, pp. 466–471 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 IFIP International Federation for Information Processing
About this paper
Cite this paper
Motten, A., Claesen, L., Pan, Y. (2013). Trinocular Stereo Vision Using a Multi Level Hierarchical Classification Structure. In: Burg, A., Coṣkun, A., Guthaus, M., Katkoori, S., Reis, R. (eds) VLSI-SoC: From Algorithms to Circuits and System-on-Chip Design. VLSI-SoC 2012. IFIP Advances in Information and Communication Technology, vol 418. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-45073-0_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-45073-0_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-45072-3
Online ISBN: 978-3-642-45073-0
eBook Packages: Computer ScienceComputer Science (R0)