Patch Matching with Polynomial Exponential Families and Projective Divergences

  • Frank NielsenEmail author
  • Richard Nock
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9939)


Given a query patch image, patch matching consists in finding similar patches in a target image. In pattern recognition, patch matching is a fundamental task that is time consuming, specially when zoom factors and symmetries are handled. The matching results heavily depend on the underlying notion of distances, or similarities, between patches. We present a method that consists in modeling patches by flexible statistical parametric distributions called polynomial exponential families (PEFs). PEFs model universally arbitrary smooth distributions, and yield a compact patch representation of complexity independent of the patch sizes. Since PEFs have computationally intractable normalization terms, we estimate PEFs with score matching, and consider a projective distance: the symmetrized \(\gamma \)-divergence. We demonstrate experimentally the performance of our patch matching system.


Patch Size Projective Divergence Target Image Exponential Family Natural Parameter 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



We gratefully thank Quei-An Chen (École Polytechnique, France) for implementing our patch matching system and performing various experiments.


  1. 1.
    Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.B.: PatchMatch: a randomized correspondence algorithm for structural image editing. ACM Trans. Graph. (TOG) 28(3), 24 (2009)CrossRefGoogle Scholar
  2. 2.
    Barnes, C., Shechtman, E., Goldman, D.B., Finkelstein, A.: The generalized PatchMatch correspondence algorithm. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6313, pp. 29–43. Springer, Heidelberg (2010). doi: 10.1007/978-3-642-15558-1_3 CrossRefGoogle Scholar
  3. 3.
    Li, Y., Dong, W., Shi, G., Xie, X.: Learning parametric distributions for image super-resolution: where patch matching meets sparse coding. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 450–458, December 2015Google Scholar
  4. 4.
    Kuglin, C.: The phase correlation image alignment method. In: Proceedings of the International Conference on Cybernetics and Society, pp. 163–165 (1975)Google Scholar
  5. 5.
    Foroosh, H., Zerubia, J.B., Berthod, M.: Extension of phase correlation to subpixel registration. IEEE Trans. Image Process. 11(3), 188–200 (2002)CrossRefGoogle Scholar
  6. 6.
    Patraucean, V., Gioi, R., Ovsjanikov, M.: Detection of mirror-symmetric image patches. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 211–216 (2013)Google Scholar
  7. 7.
    Wang, Z., Tang, Z., Zhang, X.: Reflection symmetry detection using locally affine invariant edge correspondence. IEEE Trans. Image Process. 24(4), 1297–1301 (2015)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Cobb, L., Koppstein, P., Chen, N.H.: Estimation and moment recursion relations for multimodal distributions of the exponential family. J. Am. Stat. Assoc. 78(381), 124–130 (1983)MathSciNetCrossRefzbMATHGoogle Scholar
  9. 9.
    Rohde, D., Corcoran, J.: MCMC methods for univariate exponential family models with intractable normalization constants. In: 2014 IEEE Workshop on Statistical Signal Processing (SSP), pp. 356–359, June 2014Google Scholar
  10. 10.
    Amari, S.: Information Geometry and Its Applications. Applied Mathematical Sciences. Springer, Tokyo (2016)CrossRefzbMATHGoogle Scholar
  11. 11.
    Brown, L.D.: Fundamentals of Statistical Exponential Families: With Applications in Statistical Decision Theory, vol. 9. Institute of Mathematical Statistics, Hayward (1983). 283 pages. ISSN 0749-2170.
  12. 12.
    Hyvärinen, A.: Estimation of non-normalized statistical models by score matching. J. Mach. Learn. Res. 6, 695–709 (2005)MathSciNetzbMATHGoogle Scholar
  13. 13.
    Forbes, P.G., Lauritzen, S.: Linear estimating equations for exponential families with application to Gaussian linear concentration models. Linear Algebra Its Appl. 473, 261–283 (2015). Special Issue on StatisticsMathSciNetCrossRefzbMATHGoogle Scholar
  14. 14.
    Nielsen, F., Nock, R.: A closed-form expression for the Sharma-Mittal entropy of exponential families. J. Phys. A Math. Theor. 45(3), 032003 (2011)MathSciNetCrossRefzbMATHGoogle Scholar
  15. 15.
    Nielsen, F.: Closed-form information-theoretic divergences for statistical mixtures. In: 21st International Conference on Pattern Recognition (ICPR), pp. 1723–1726. IEEE (2012)Google Scholar
  16. 16.
    Nielsen, F., Nock, R.: On the chi square and higher-order chi distances for approximating \(f\)-divergences. IEEE Sig. Process. Lett. 1(21), 10–13 (2014)CrossRefGoogle Scholar
  17. 17.
    Banerjee, A., Merugu, S., Dhillon, I.S., Ghosh, J.: Clustering with Bregman divergences. J. Mach. Learn. Res. 6, 1705–1749 (2005)MathSciNetzbMATHGoogle Scholar
  18. 18.
    Fujisawa, H., Eguchi, S.: Robust parameter estimation with a small bias against heavy contamination. J. Multivariate Anal. 99(9), 2053–2081 (2008)MathSciNetCrossRefzbMATHGoogle Scholar
  19. 19.
    Notsu, A., Komori, O., Eguchi, S.: Spontaneous clustering via minimum gamma-divergence. Neural Comput. 26(2), 421–448 (2014)MathSciNetCrossRefGoogle Scholar
  20. 20.
    Chen, T.L., Hsieh, D.N., Hung, H., Tu, I.P., Wu, P.S., Wu, Y.M., Chang, W.H., Huang, S.Y., et al.: \(\gamma \)-SUP: a clustering algorithm for cryo-electron microscopy images of asymmetric particles. Ann. Appl. Stat. 8(1), 259–285 (2014)MathSciNetCrossRefzbMATHGoogle Scholar
  21. 21.
    Ehm, W.: Unbiased risk estimation and scoring rules. Comptes Rendus Mathématiques 349(11), 699–702 (2011)MathSciNetCrossRefzbMATHGoogle Scholar
  22. 22.
    Crow, F.C.: Summed-area tables for texture mapping. ACM SIGGRAPH Comput. Graph. 18(3), 207–212 (1984)CrossRefGoogle Scholar
  23. 23.
    Rother, C., Kolmogorov, V., Blake, A.: GrabCut: Interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. (TOG) 23(3), 309–314 (2004)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.École PolytechniquePalaiseauFrance
  2. 2.Sony Computer Science Laboratories Inc.TokyoJapan
  3. 3.Data61Sydney ATPSydneyAustralia
  4. 4.The Australian National UniversitySydneyAustralia

Personalised recommendations