Architectural Analysis of a Baseline ISP Pipeline

Part of the KAIST Research Series book series (KAISTRS)


An ISP is an entity that performs various image-processing algorithms on a raw image from an image sensor. A number of functions are incorporated in an ISP, and they are combined together similarly but differently among ISP implementers. ISP functions are divided into pixel-based and frame-based ones, and are dedicated to one of three color domains in Bayer, RGB, or YCbCr. Although it is an essential component for a camera system, surprisingly, its architecture has not been analyzed in the context of standards. The purpose of this chapter is to remove ambiguity when analyzing an ISP architecture or designing a new ISP architecture. At the end of this chapter, a baseline ISP pipeline is presented, which is tentatively built to conform to the existing standards.


Image signal processor Image pipeline Image sensor Bayer sensor 



This work is supported by the Center for Integrated Smart Sensors funded by the Ministry of Science, ICT & Future Planning as the Global Frontier Project.


  1. 1.
    Recommendation ITU-R BT.601-7, Studio encoding parameters of digital television for standard 4:3 and wide-screen 16:9 aspect ratios, ITU, March 2011Google Scholar
  2. 2.
    Recommendation ITU-R BT.656-4, Interface for digital component video signals in 525-line and 625-line television systems operating at the 4:2:2 level of Recommendation ITU-R BT.601, ITU, Dec 2007Google Scholar
  3. 3.
    Recommendation ITU-R BT.709-5, Parameter values for the HDTV standards for production and international programme exchange, ITU, Feb 2004Google Scholar
  4. 4.
    Recommendation ITU-R BT.2020-1, Parameter values for ultra-high definition television systems for production and international programme exchange, ITU, July 2014Google Scholar
  5. 5.
  6. 6.
    Bayer BE (1976) US Patent 3971065. Color imaging array. Accessed 20 July 1976Google Scholar
  7. 7.
    Gunturk Bahadir K, Glotzbach John, Altunbasak Yucel, Schafer Ronald W, Mersereau Russel M (2005) Demosaicking: color filter array interpolation. IEEE Signal Process Mag 22(1):44–54CrossRefGoogle Scholar
  8. 8.
    Buades A, Coll B, Morel JM (2005) A review of image denoising algorithms, with a new one. Multisc Model Simul 4(2):490–530MathSciNetCrossRefzbMATHGoogle Scholar
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
    Laroche CA, Prescott MA (1994) Apparatus and method for adaptively interpolating a full color image utilizing chrominance gradients. US Patent 5,373,322Google Scholar
  20. 20.

Copyright information

© Springer Science+Business Media Dordrecht 2016

Authors and Affiliations

  1. 1.Division of Electrical Electronics and Control EngineeringKongju National UniversityGongjuSouth Korea

Personalised recommendations