FPGA-Based Real-Time Super-Resolution on an Adaptive Image Sensor
Recent technological advances in imaging industry have lead to the production of imaging systems with high density pixel sensors. However, their long exposure times limit their applications to static images due to the motion blur effect. This work presents a system that reduces the motion blurring using a time-variant image sensor. This sensor can combine several pixels together to form a larger pixel when it is necessary. Larger pixels require shorter exposure times and produce high frame-rate samples with reduced motion blur. An FPGA is employed to enhance the spatial resolution of these samples employing Super Resolution (SR) techniques in real-time. This work focuses on the spatial resolution enhancement block and presents an FPGA implementation of the Iterative Back Projection (IBP) SR algorithm. The proposed architecture achieves 25 fps for VGA input and can serve as a general purpose real-time resolution enhancement system.
KeywordsPoint Spread Function Motion Blur Super Resolution FPGA Implementation CMOS Image Sensor
Unable to display preview. Download preview PDF.
- 2.Farrell, J., Xiao, F., Kavusi, S.: Resolution and Light Sensitivity Tradeoff with Pixel Size. In: SPIE Electronic Imaging 2006 Conference, vol. 6069, pp. 211–218 (February 2006)Google Scholar
- 5.Constandinou, T.G., Degenaar, P., Toumazou, C.: An Adaptable Foveating Vision Chip. In: IEEE International Symposium on Circuits and Systems (ISCAS), May 2006, pp. 3566–3569 (2006)Google Scholar
- 7.Bouguet, J.-Y.: Pyramidal Implementation of the Lucas Kanade Feature Tracker - Description of the algorithm. Intel Corporation, Microprocessor Research Labs, Part of OpenCV Documentation, http://sourceforge.net/projects/opencvlibrary/
- 8.Irani, M., Peleg, S.: Improving Resolution by Image Registration. In: CVGIP: Graphical Models and Image Proc, May 1991 vol. 53(3), pp. 231–239 (May 1991)Google Scholar
- 9.Shi, J., Tomasi, C.: Good Features to Track. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 1994) (June 1994), pp. 593–600 (1994)Google Scholar