Inverse Kernels for Fast Spatial Deconvolution

  • Li Xu
  • Xin Tao
  • Jiaya Jia
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8693)


Deconvolution is an indispensable tool in image processing and computer vision. It commonly employs fast Fourier transform (FFT) to simplify computation. This operator, however, needs to transform from and to the frequency domain and loses spatial information when processing irregular regions. We propose an efficient spatial deconvolution method that can incorporate sparse priors to suppress noise and visual artifacts. It is based on estimating inverse kernels that are decomposed into a series of 1D kernels. An augmented Lagrangian method is adopted, making inverse kernel be estimated only once for each optimization process. Our method is fully parallelizable and its speed is comparable to or even faster than other strategies employing FFTs.


deconvolution inverse kernels numerical analysis optimization 


  1. 1.
    Afonso, M.V., Bioucas-Dias, J.M., Figueiredo, M.A.: An augmented lagrangian approach to the constrained optimization formulation of imaging inverse problems. IEEE Transactions on Image Processing 20(3), 681–695 (2011)CrossRefMathSciNetGoogle Scholar
  2. 2.
    Agrawal, A.K., Raskar, R.: Resolving objects at higher resolution from a single motion-blurred image. In: CVPR (2007)Google Scholar
  3. 3.
    Chakrabarti, A., Zickler, T., Freeman, W.T.: Analyzing spatially-varying blur. In: CVPR, pp. 2512–2519 (2010)Google Scholar
  4. 4.
    Cho, S., Lee, S.: Fast motion deblurring. ACM Trans. Graph. 28(5) (2009)Google Scholar
  5. 5.
    Danielyan, A., Katkovnik, V., Egiazarian, K.: Image deblurring by augmented lagrangian with bm3d frame prior. In: Workshop on Information Theoretic Methods in Science and Engineering, pp. 16–18 (2010)Google Scholar
  6. 6.
    Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.T.: Removing camera shake from a single photograph. ACM Trans. Graph. 25(3), 787–794 (2006)CrossRefGoogle Scholar
  7. 7.
    Freeman, W.T., Adelson, E.H.: The design and use of steerable filters. IEEE Trans. Pattern Anal. Mach. Intell. 13(9), 891–906 (1991)CrossRefGoogle Scholar
  8. 8.
    Irani, M., Peleg, S.: Motion analysis for image enhancement: Resolution, occlusion, and transparency. Journal of Visual Communication and Image Representation 4(4) (1993)Google Scholar
  9. 9.
    Jerosch-Herold, M., Wilke, N., Stillman, A.E., Wilson, R.F.: Magnetic resonance quantification of the myocardial perfusion reserve with a fermi function model for constrained deconvolution. Medical physics 25, 73 (1998)CrossRefGoogle Scholar
  10. 10.
    Joshi, N., Zitnick, C.L., Szeliski, R., Kriegman, D.J.: Image deblurring and denoising using color priors. In: CVPR, pp. 1550–1557 (2009)Google Scholar
  11. 11.
    Krishnan, D., Fergus, R.: Fast image deconvolution using hyper-laplacian priors. In: NIPS (2009)Google Scholar
  12. 12.
    Kuthirummal, S., Nagahara, H., Zhou, C., Nayar, S.K.: Flexible depth of field photography. IEEE Trans. Pattern Anal. Mach. Intell. 33(1), 58–71 (2011)CrossRefGoogle Scholar
  13. 13.
    Levin, A., Fergus, R., Durand, F., Freeman, W.T.: Image and depth from a conventional camera with a coded aperture. ACM Trans. Graph. 26(3), 70 (2007)CrossRefGoogle Scholar
  14. 14.
    Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Understanding and evaluating blind deconvolution algorithms. In: CVPR, pp. 1964–1971 (2009)Google Scholar
  15. 15.
    Lin, Z., Chen, M., Ma, Y.: The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrices. UIUC Technical Report UILU-ENG-09-2215 (2010)Google Scholar
  16. 16.
    Mathews, J., Walker, R.L.: Mathematical methods of physics, vol. 271. WA Benjamin New York (1970)Google Scholar
  17. 17.
    Michaeli, T., Irani, M.: Nonparametric blind super-resolution. In: ICCV (2ss013)Google Scholar
  18. 18.
    Perona, P.: Deformable kernels for early vision. IEEE Trans. Pattern Anal. Mach. Intell. 17(5), 488–499 (1995)CrossRefGoogle Scholar
  19. 19.
    Raskar, R., Agrawal, A.K., Tumblin, J.: Coded exposure photography: motion deblurring using fluttered shutter. ACM Trans. Graph. 25(3), 795–804 (2006)CrossRefGoogle Scholar
  20. 20.
    Richardson, W.H.: Bayesian-based iterative method of image restoration. Journal of the Optical Society of America 62(1), 55–59 (1972)CrossRefGoogle Scholar
  21. 21.
    Schmidt, U., Rother, C., Nowozin, S., Jancsary, J., Roth, S.: Discriminative non-blind deblurring. In: CVPR, pp. 604–611 (2013)Google Scholar
  22. 22.
    Shan, Q., Jia, J., Agarwala, A.: High-quality motion deblurring from a single image. ACM Trans. Graph. 27(3) (2008)Google Scholar
  23. 23.
    Shan, Q., Li, Z., Jia, J., Tang, C.-K.: Fast image/video upsampling. ACM Trans. Graph. 27(5), 153 (2008)CrossRefGoogle Scholar
  24. 24.
    Starck, J.L., Pantin, E., Murtagh, F.: Deconvolution in astronomy: A review. Publications of the Astronomical Society of the Pacific 114(800), 1051–1069 (2002)CrossRefGoogle Scholar
  25. 25.
    Tai, Y.-W., Lin, S.: Motion-aware noise filtering for deblurring of noisy and blurry images. In: CVPR, pp. 17–24 (2012)Google Scholar
  26. 26.
    Tikhonov, A., Arsenin, V., John, F.: Solutions of ill-posed problems (1977)Google Scholar
  27. 27.
    Wiener, N.: Extrapolation, interpolation, and smoothing of stationary time series: with engineering applications. Journal of the American Statistical Association 47(258) (1949)Google Scholar
  28. 28.
    Xu, L., Jia, J.: Two-phase kernel estimation for robust motion deblurring. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part I. LNCS, vol. 6311, pp. 157–170. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  29. 29.
    Xu, L., Zheng, S., Jia, J.: Unnatural l0 sparse representation for natural image deblurring. In: CVPR, pp. 1107–1114 (2013)Google Scholar
  30. 30.
    Yuan, L., Sun, J., Quan, L., Shum, H.-Y.: Image deblurring with blurred/noisy image pairs. ACM Trans. Graph. 26(3), 1 (2007)CrossRefzbMATHGoogle Scholar
  31. 31.
    Yuan, L., Sun, J., Quan, L., Shum, H.-Y.: Progressive inter-scale and intra-scale non-blind image deconvolution. ACM Trans. Graph. 27(3) (2008)Google Scholar
  32. 32.
    Zhou, C., Lin, S., Nayar, S.K.: Coded aperture pairs for depth from defocus and defocus deblurring. International Journal of Computer Vision 93(1), 53–72 (2011)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Li Xu
    • 1
  • Xin Tao
    • 2
  • Jiaya Jia
    • 2
  1. 1.Image & Visual Computing LabLenovo R&THong Kong
  2. 2.The Chinese University of Hong KongHong Kong

Personalised recommendations