Weighted Non-locally Self-similarity Sparse Representation for Face Deblurring

  • Lei Tian
  • Chunxiao Fan
  • Yue MingEmail author
  • Xiaopeng Hong
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10116)


The human face is one of the most interesting subjects in various computer vision tasks. In recent years, significant progress has been made for generic image deblurring problem, but existing popular sparse representation based deblurring methods are not able to achieve excellent results on blurry face images. The failure of these methods mainly stems from the lack of local/non-local self-similarity prior knowledge. There are many similar non-local patches in the neighborhood of a given patch in a face image, therefore, this property should be effectively exploited to obtain a good estimation of the sparse coding coefficients. In this paper, we introduce the current weighted non-locally self-similarity (WNLSS) method [1], which is originally proposed to remove the noise for natural images, into the face deblurring model. There are two terms in the WNLSS sparse representation model, data fidelity term and regularization term. Based on the theoretical analysis, we show the properties of data fidelity term and regularization term also can fit well for face deblurring problem. The results also demonstrate that WNLSS method can achieve excellent performance in terms of both synthetic and real blurred face dataset.


Face Image Sparse Representation Local Patch Blur Kernel Weighted Code 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



The work presented in this paper was supported by the National Natural Science Foundation of China (Grants No. NSFC-61402046), Fund for Beijing University of Posts and Telecommunications (No.2013XZ10, 2013XD-04), Fund for the Doctoral Program of Higher Education of China (Grants No.20120005110002).


  1. 1.
    Jiang, J., Zhang, L., Yang, J.: Mixed noise removal by weighted encoding with sparse nonlocal regularization. IEEE Trans. Image Process. 23, 2651–2662 (2014)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Cho, S., Lee, S.: Fast motion deblurring. In: ACM SIGGRAPH Asia 2009 Papers, SIGGRAPH Asia 2009, pp. 145:1–145:8, ACM, New York (2009)Google Scholar
  3. 3.
    Shan, Q., Jia, J., Agarwala, A.: High-quality motion deblurring from a single image. ACM Trans. Graph. 27, 73:1–73:10 (2008)Google Scholar
  4. 4.
    Xu, L., Jia, J.: Two-phase kernel estimation for robust motion deblurring. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6311, pp. 157–170. Springer, Heidelberg (2010). doi: 10.1007/978-3-642-15549-9_12 CrossRefGoogle Scholar
  5. 5.
    Mairal, J., Bach, F., Ponce, J., Sapiro, G., Zisserman, A.: Non-local sparse models for image restoration. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 2272–2279. IEEE (2009)Google Scholar
  6. 6.
    Dong, W., Zhang, L., Shi, G., Wu, X.: Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization. IEEE Trans. Image Process. 20, 1838–1857 (2011)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Sun, L., Cho, S., Wang, J., Hays, J.: Edge-based blur kernel estimation using patch priors. In: 2013 IEEE International Conference on Computational Photography (ICCP), pp. 1–8. IEEE (2013)Google Scholar
  8. 8.
    Pan, J., Hu, Z., Su, Z., Yang, M.-H.: Deblurring face images with exemplars. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8695, pp. 47–62. Springer, Cham (2014). doi: 10.1007/978-3-319-10584-0_4 Google Scholar
  9. 9.
    Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Efficient marginal likelihood optimization in blind deconvolution. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2657–2664. IEEE (2011)Google Scholar
  10. 10.
    Oliveira, J.P., Bioucas-Dias, J.M., Figueiredo, M.A.: Adaptive total variation image deblurring: a majorization-minimization approach. Sig. Process. 89, 1683–1693 (2009)CrossRefzbMATHGoogle Scholar
  11. 11.
    Cai, J.F., Ji, H., Liu, C., Shen, Z.: Framelet-based blind motion deblurring from a single image. IEEE Trans. Image Process. 21, 562–572 (2012)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Dong, W., Shi, G., Hu, X., Ma, Y.: Nonlocal sparse and low-rank regularization for optical flow estimation. IEEE Trans. Image Process. 23, 4527–4538 (2014)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Chen, J., Yi, D., Yang, J., Zhao, G., Li, S.Z., Pietikainen, M.: Learning mappings for face synthesis from near infrared to visual light images. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, pp. 156–163. IEEE (2009)Google Scholar
  14. 14.
    Krishnan, D., Tay, T., Fergus, R.: Blind deconvolution using a normalized sparsity measure. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 233–240. IEEE (2011)Google Scholar
  15. 15.
    Xu, L., Zheng, S., Jia, J.: Unnatural L0 sparse representation for natural image deblurring. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1107–1114 (2013)Google Scholar
  16. 16.
    Mairal, J., Sapiro, G., Elad, M.: Learning multiscale sparse representations for image and video restoration. Multiscale Model. Simul. 7, 214–241 (2008)MathSciNetCrossRefzbMATHGoogle Scholar
  17. 17.
    Rubinstein, R., Bruckstein, A.M., Elad, M.: Dictionaries for sparse representation modeling. Proc. IEEE 98, 1045–1057 (2010)CrossRefGoogle Scholar
  18. 18.
    Elad, M., Yavneh, I.: A plurality of sparse representations is better than the sparsest one alone. IEEE Trans. Inf. Theor. 55, 4701–4714 (2009)MathSciNetCrossRefGoogle Scholar
  19. 19.
    Aharon, M., Elad, M., Bruckstein, A.: K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans. Sig. Process. 54, 4311–4322 (2006)CrossRefGoogle Scholar
  20. 20.
    Dong, W., Zhang, L., Shi, G., Li, X.: Nonlocally centralized sparse representation for image restoration. IEEE Trans. Image Process. 22, 1620–1630 (2013)MathSciNetCrossRefGoogle Scholar
  21. 21.
    Daubechies, I., DeVore, R., Fornasier, M., Güntürk, C.S.: Iteratively reweighted least squares minimization for sparse recovery. Commun. Pure Appl. Math. 63, 1–38 (2010)MathSciNetCrossRefzbMATHGoogle Scholar
  22. 22.
    Zhang, L., Zhang, L., Mou, X., Zhang, D.: FSIM: a feature similarity index for image quality assessment. IEEE Trans. Image Process. 20, 2378–2386 (2011)MathSciNetCrossRefGoogle Scholar
  23. 23.
    Kheradmand, A., Milanfar, P.: A general framework for regularized, similarity-based image restoration. IEEE Trans. Image Process. 23, 5136–5151 (2014)MathSciNetCrossRefGoogle Scholar
  24. 24.
    Portilla, J.: Image restoration through L0 analysis-based sparse optimization in tight frames. In: 2009 16th IEEE International Conference on Image Processing (ICIP), pp. 3909–3912. IEEE (2009)Google Scholar
  25. 25.
    Beck, A., Teboulle, M.: Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE Trans. Image Process. 18, 2419–2434 (2009)MathSciNetCrossRefGoogle Scholar
  26. 26.
    Beveridge, J.R., Phillips, J., Bolme, D.S., Draper, B., Givens, G.H., Lui, Y.M., Teli, M.N., Zhang, H., Scruggs, W.T., Bowyer, K.W., et al.: The challenge of face recognition from digital point-and-shoot cameras. In: 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS), pp. 1–8. IEEE (2013)Google Scholar
  27. 27.
    Danielyan, A., Katkovnik, V., Egiazarian, K.: BM3D frames and variational image deblurring. IEEE Trans. Image Process. 21, 1715–1728 (2012)MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Lei Tian
    • 1
  • Chunxiao Fan
    • 1
  • Yue Ming
    • 1
    Email author
  • Xiaopeng Hong
    • 2
  1. 1.Beijing Key Laboratory of Work Safety Intelligent Monitoring, School of Electronic EngineeringBeijing University of Posts and TelecommunicationsBeijingPeople’s Republic of China
  2. 2.Department of Computer Science and EngineeringUniversity of OuluOuluFinland

Personalised recommendations