Advertisement

FPGA-Based Real-Time Super-Resolution on an Adaptive Image Sensor

  • Maria E. Angelopoulou
  • Christos-Savvas Bouganis
  • Peter Y. K. Cheung
  • George A. Constantinides
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4943)

Abstract

Recent technological advances in imaging industry have lead to the production of imaging systems with high density pixel sensors. However, their long exposure times limit their applications to static images due to the motion blur effect. This work presents a system that reduces the motion blurring using a time-variant image sensor. This sensor can combine several pixels together to form a larger pixel when it is necessary. Larger pixels require shorter exposure times and produce high frame-rate samples with reduced motion blur. An FPGA is employed to enhance the spatial resolution of these samples employing Super Resolution (SR) techniques in real-time. This work focuses on the spatial resolution enhancement block and presents an FPGA implementation of the Iterative Back Projection (IBP) SR algorithm. The proposed architecture achieves 25 fps for VGA input and can serve as a general purpose real-time resolution enhancement system.

Keywords

Point Spread Function Motion Blur Super Resolution FPGA Implementation CMOS Image Sensor 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Gamal, A.E., Eltoukhy, H.: CMOS image sensors. IEEE Circuits & Devices Magazine 21(3), 6–20 (2005)CrossRefGoogle Scholar
  2. 2.
    Farrell, J., Xiao, F., Kavusi, S.: Resolution and Light Sensitivity Tradeoff with Pixel Size. In: SPIE Electronic Imaging  2006 Conference, vol. 6069, pp. 211–218 (February 2006)Google Scholar
  3. 3.
    Shechtman, E., Caspi, Y., Irani, M.: Space-Time Super-Resolution. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(4), 531–545 (2005)CrossRefGoogle Scholar
  4. 4.
    Ben-Ezra, M., Nayar, S.K.: Motion-based motion deblurring. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(6), 689–698 (2004)CrossRefGoogle Scholar
  5. 5.
    Constandinou, T.G., Degenaar, P., Toumazou, C.: An Adaptable Foveating Vision Chip. In: IEEE International Symposium on Circuits and Systems (ISCAS), May 2006, pp. 3566–3569 (2006)Google Scholar
  6. 6.
  7. 7.
    Bouguet, J.-Y.: Pyramidal Implementation of the Lucas Kanade Feature Tracker - Description of the algorithm. Intel Corporation, Microprocessor Research Labs, Part of OpenCV Documentation, http://sourceforge.net/projects/opencvlibrary/
  8. 8.
    Irani, M., Peleg, S.: Improving Resolution by Image Registration. In: CVGIP: Graphical Models and Image Proc, May 1991 vol. 53(3), pp. 231–239 (May 1991)Google Scholar
  9. 9.
    Shi, J., Tomasi, C.: Good Features to Track. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 1994) (June 1994), pp. 593–600 (1994)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Maria E. Angelopoulou
    • 1
  • Christos-Savvas Bouganis
    • 1
  • Peter Y. K. Cheung
    • 1
  • George A. Constantinides
    • 1
  1. 1.Department of Electrical and Electronic EngineeringImperial College LondonLondonUK

Personalised recommendations