Patch Group Based Bayesian Learning for Blind Image Denoising

  • Jun Xu
  • Dongwei Ren
  • Lei ZhangEmail author
  • David Zhang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10116)


Most existing image denoising methods assume to know the noise distributions, e.g., Gaussian noise, impulse noise, etc. However, in practice the noise distribution is usually unknown and is more complex, making image denoising still a challenging problem. In this paper, we propose a novel blind image denoising method under the Bayesian learning framework, which automatically performs noise inference and reconstructs the latent clean image. By utilizing the patch group (PG) based image nonlocal self-similarity prior, we model the PG variations as Mixture of Gaussians, whose parameters, including the number of components, are automatically inferred by variational Bayesian method. We then employ nonparametric Bayesian dictionary learning to extract the latent clean structures from the PG variations. The dictionaries and coefficients are automatically inferred by Gibbs sampling. The proposed method is evaluated on images with Gaussian noise, images with mixed Gaussian and impulse noise, and real noisy photographed images, in comparison with state-of-the-art denoising methods. Experimental results show that our proposed method performs consistently well on all types of noisy images in terms of both quantitative measure and visual quality, while those competing methods can only work well on the specific type of noisy images they are designed for and perform poorly on other types of noisy images. The proposed method provides a good solution to blind image denoising.


Noisy Image Impulse Noise Image Denoising Dictionary Learning Patch Group 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D: Nonlinear Phenomena 60, 259–268 (1992)MathSciNetCrossRefzbMATHGoogle Scholar
  2. 2.
    Buades, A., Coll, B., Morel, J.M.: A non-local algorithm for image denoising. In: CVPR, pp. 60–65 (2005)Google Scholar
  3. 3.
    Roth, S., Black, M.J.: Fields of experts. Int. J. Comput. Vis. 82, 205–229 (2009)CrossRefGoogle Scholar
  4. 4.
    Elad, M., Aharon, M.: Image denoising via sparse and redundant representations over learned dictionaries. IEEE Trans. Image Process. 15, 3736–3745 (2006)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process. 16, 2080–2095 (2007)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Mairal, J., Bach, F., Ponce, J., Sapiro, G., Zisserman, A.: Non-local sparse models for image restoration. In: ICCV, pp. 2272–2279 (2009)Google Scholar
  7. 7.
    Zoran, D., Weiss, Y.: From learning models of natural image patches to whole image restoration. In: ICCV, pp. 479–486 (2011)Google Scholar
  8. 8.
    Burger, H.C., Schuler, C.J., Harmeling, S.: Image denoising: can plain neural networks compete with bm3d. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2392–2399. IEEE (2012)Google Scholar
  9. 9.
    Cai, J.F., Chan, R.H., Nikolova, M.: Fast two-phase image deblurring under impulse noise. J. Math. Imaging Vis. 36, 46–53 (2010)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Xiao, Y., Zeng, T., Yu, J., Ng, M.K.: Restoration of images corrupted by mixed gaussian-impulse noise via 11–10 minimization. Pattern Recogn. 44, 1708–1720 (2011)CrossRefzbMATHGoogle Scholar
  11. 11.
    Jiang, J., Zhang, L., Yang, J.: Mixed noise removal by weighted encoding with sparse nonlocal regularization. IEEE Trans. Image Process. 23, 2651–2662 (2014)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Portilla, J., Strela, V., Wainwright, M., Simoncelli, E.: Image denoising using scale mixtures of Gaussians in the wavelet domain. IEEE Trans. Image Process. 12, 1338–1351 (2003)MathSciNetCrossRefzbMATHGoogle Scholar
  13. 13.
    Portilla, J.: Full blind denoising through noise covariance estimation using gaussian scale mixtures in the wavelet domain. In: 2004 International Conference on Image Processing, ICIP 2004, vol. 2, pp. 1217–1220 (2004)Google Scholar
  14. 14.
    Huber, P.J.: Robust Statistics. Springer (2011)Google Scholar
  15. 15.
    Rabie, T.: Robust estimation approach for blind denoising. IEEE Trans. Image Process. 14, 1755–1765 (2005)CrossRefGoogle Scholar
  16. 16.
    Liu, C., Szeliski, R., Kang, S.B., Zitnick, C.L., Freeman, W.T.: Automatic estimation and removal of noise from a single image. IEEE Trans. Pattern Anal. Mach. Intell. 30, 299–314 (2008)CrossRefGoogle Scholar
  17. 17.
    Gong, Z., Shen, Z., Toh, K.C.: Image restoration with mixed or unknown noises. Multiscale Model. Simul. 12, 458–487 (2014)CrossRefzbMATHGoogle Scholar
  18. 18.
    Lebrun, M., Colom, M., Morel, J.M.: Multiscale image blind denoising. IEEE Trans. Image Process. 24, 3149–3161 (2015)MathSciNetCrossRefGoogle Scholar
  19. 19.
    Lebrun, M., Buades, A., Morel, J.M.: A nonlocal bayesian image denoising algorithm. SIAM J. Imaging Sci. 6, 1665–1688 (2013)MathSciNetCrossRefzbMATHGoogle Scholar
  20. 20.
    Hjort, N.L.: Nonparametric bayes estimators based on beta processes in models for life history data. Ann. Stat. 18, 1259–1294 (1990)MathSciNetCrossRefzbMATHGoogle Scholar
  21. 21.
    Thibaux, R., Jordan, M.I.: Hierarchical beta processes and the Indian buffet process. In: International Conference on Artificial Intelligence and Statistics, pp. 564–571 (2007)Google Scholar
  22. 22.
    Paisley, J., Carin, L.: Nonparametric factor analysis with beta process priors. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 777–784. ACM (2009)Google Scholar
  23. 23.
    Yu, G., Sapiro, G., Mallat, S.: Solving inverse problems with piecewise linear estimators: from Gaussian mixture models to structured sparsity. IEEE Trans. Image Process. 21, 2481–2499 (2012)MathSciNetCrossRefGoogle Scholar
  24. 24.
    Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, New York (2006)zbMATHGoogle Scholar
  25. 25.
    Dong, W., Zhang, L., Shi, G., Li, X.: Nonlocally centralized sparse representation for image restoration. IEEE Trans. Image Process. 22, 1620–1630 (2013)MathSciNetCrossRefGoogle Scholar
  26. 26.
    Xu, J., Zhang, L., Zuo, W., Zhang, D., Feng, X.: Patch group based nonlocal self-similarity prior learning for image denoising. In: The IEEE International Conference on Computer Vision (ICCV), pp. 244–252 (2015)Google Scholar
  27. 27.
    Zhou, M., Chen, H., Ren, L., Sapiro, G., Carin, L., Paisley, J.W.: Non-parametric bayesian dictionary learning for sparse image representations. In: NIPS, pp. 2295–2303 (2009)Google Scholar
  28. 28.
    Ferguson, T.S.: A bayesian analysis of some nonparametric problems. Ann. Stat. 1, 209–230 (1973)MathSciNetCrossRefzbMATHGoogle Scholar
  29. 29.
    Ren, L., Du, L., Carin, L., Dunson, D.: Logistic stick-breaking process. J. Mach. Learn. Res. 12, 203–239 (2011)MathSciNetzbMATHGoogle Scholar
  30. 30.
    Gu, S., Zhang, L., Zuo, W., Feng, X.: Weighted nuclear norm minimization with application to image denoising. In: CVPR, pp. 2862–2869 (2014)Google Scholar
  31. 31.
    Zhou, M., Chen, H., Paisley, J., Ren, L., Li, L., Xing, Z., Dunson, D., Sapiro, G., Carin, L.: Nonparametric bayesian dictionary learning for analysis of noisy and incomplete images. IEEE Trans. Image Process. 21, 130–144 (2012)MathSciNetCrossRefGoogle Scholar
  32. 32.
    Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13, 600–612 (2004)CrossRefGoogle Scholar
  33. 33.
    ABSoft, N.: Neat image.
  34. 34.
    Liu, X., Tanaka, M., Okutomi, M.: Single-image noise level estimation for blind denoising. IEEE Trans. Image Process. 22, 5226–5237 (2013)CrossRefGoogle Scholar
  35. 35.
    Hwang, H., Haddad, R.: Adaptive median filters: new algorithms and results. IEEE Trans. Image Process. 4, 499–502 (1995)CrossRefGoogle Scholar
  36. 36.
    Lebrun, M., Colom, M., Morel, J.M.: The noise clinic: a blind image denoising algorithm. Accessed 28 Jan 2015

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Department of ComputingThe Hong Kong Polytechnic UniversityHong KongChina
  2. 2.School of Computer Science and TechnologyHarbin Institute of TechnologyHarbinChina

Personalised recommendations