Leveraging Mutual Information in Local Descriptions: From Local Binary Patterns to the Image

  • Tahir Q. SyedEmail author
  • Sadaf I. Behlim
  • Alishan K. Merchant
  • Alexis Thomas
  • Furqan M. Khan
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9280)


Local image descriptors provide robust descriptions of image localities. Their geometric arrangement provides additional information about the image they describe, a fact often ignored when employing them to that wide slew of tasks from image registration to scene classification. On the premise that descriptor quality could be assessed in terms of its expressiveness of image content, we investigate the use of the described as well as that additional geometric information to the task of recovering the image from its local descriptors. This paper uses Local Binary Patterns, an operator nested in a dense geometry, to study how this additional information in the form of constraints among pixels dictates the intensity estimated for a pixel. We determine that constraints propagate from regional extrema to regions around them that observe the same constraint class, and that the intensity for any of the region’s pixels influences that for all others. We build a directed constraint graph of pixel nodes such that the arcs on the graph are strongly k-consistent, and propagate intensity estimates from extremum nodes. Evaluations are run on the SIPI texture and the BSD500 datasets. The estimates preserve the local structure of the image, as shown by the Mean Absolute Error of about \(15\%\) and \(18\%\) respectively and Structural Texture SIMilarity of about \(92\%\) for both datasets, in addition to observing \(100\%\) constraint satisfaction.


Local Binary Pattern Local Description Regional Minimum Propagation Extent Constraint Graph 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Yao, C.-H., Chen, S.-Y.: Retrieval of translated, rotated and scaled color textures. Pattern Recognition 36(4), 913–929 (2003)CrossRefMathSciNetGoogle Scholar
  2. 2.
    Wang, H., Ullah, M.M., Klaser, A., Laptev, I., Schmid, C: Evaluation of local spatio-temporal features for action recognition. In: Procedings of the British Machine Vision Conference 2009, pp. 124.1–124.11 (2009)Google Scholar
  3. 3.
    Kellokumpu, V., Zhao, G., Li, S.Z., Pietikäinen, M.: Dynamic Texture Based Gait Recognition, pp. 1000–1009 (2009)Google Scholar
  4. 4.
    Zhao, G., Chen, J., Pietikäinen, M.: An improved local descriptor and threshold learning for unsupervised dynamic texture segmentation. In: Proc. 2nd IEEE International Workshop on Machine Learning for Vision-based Motion Analysis (MLVMA 2009), Kyoto, Japan, pp. 460–467 (2009)Google Scholar
  5. 5.
    Mikolajczyk, K., Schmid, C.: A Performance Evaluation of Local Descriptors. IEEE Transaction on Pattern Analysis and Machine Intelligence 27, 1615–1630 (2005)CrossRefGoogle Scholar
  6. 6.
    Weinzaepfel, P., Jégou, H., Pérez, P.: Reconstructing an image from its local descriptors. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 337–344 (2011)Google Scholar
  7. 7.
    Daneshi, M., Guo, J.: Image reconstruction based on local feature descriptors (2011)Google Scholar
  8. 8.
    Wu, J., Rehg, J.M.: CENTRIST: A Visual Descriptor for Scene Categorization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1–14, December 2010Google Scholar
  9. 9.
    Waller, B.M., Nixon, M.S., Carter, J.N.: Image reconstruction from local binary patterns. In: 2013 International Conference on Signal-Image Technology & Internet-Based Systems, pp. 118–123. IEEE, December 2013Google Scholar
  10. 10.
    Gudmundsson, B., Kruse, B., Antonsson, D.: PICAP and Relational Neighborhood Processing in FIPGoogle Scholar
  11. 11.
    Lindahl, T:. Study of Local Binary Patterns Study of Local Binary Patterns Examensarbete utfört i medieteknik Tobias Lindahl (2007)Google Scholar
  12. 12.
    Timo, O., Pietikätinen, M., Harwood, D.: A comparative study of texture measures with classification based on featured distributions. Pattern Recognition 29(1), 51–59 (1996)CrossRefGoogle Scholar
  13. 13.
    Qing, X., Yang, J., Ding, S.: Texture segmentation using lbp embedded region competition. Electronic Letters on Computer Vision and Image Analysis 5(1), 41–47 (2005)Google Scholar
  14. 14.
    Mackworth, A.: Consistency in networks of relations. Artificial Intelligence 8(1), 99–118 (1977)CrossRefMathSciNetzbMATHGoogle Scholar
  15. 15.
    Freuder, C.E.: Synthesizing constraint expressions. Commun. ACM 21(11), 958–966 (1978)CrossRefMathSciNetzbMATHGoogle Scholar
  16. 16.
    Freuder, E.C.: A sufficient condition for backtrack-free search. J. ACM 29(1), 24–32 (1982)CrossRefMathSciNetzbMATHGoogle Scholar
  17. 17.
    Zujovic, J., Pappas, T.N., Neuhoff, D.L.: Structural similarity metrics for texture analysis and retrieval. In: 2009 16th IEEE International Conference on Image Processing (ICIP), vol. 22(7), pp. 2545–2558 (2009)Google Scholar
  18. 18.
    Ortiz, R.: Freak: Fast retina keypoint. In: Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2012, pp. 510–517. IEEE Computer Society, Washington, DC (2012)Google Scholar
  19. 19.
    Calonder, M., Lepetit, V., Strecha, C., Fua, P.: BRIEF: Binary robust independent elementary features. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part IV. LNCS, vol. 6314, pp. 778–792. Springer, Heidelberg (2010) CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Tahir Q. Syed
    • 1
    Email author
  • Sadaf I. Behlim
    • 1
  • Alishan K. Merchant
    • 1
  • Alexis Thomas
    • 1
  • Furqan M. Khan
    • 1
  1. 1.Visual Analytics LabNational University of Computer and Emerging SciencesKarachiPakistan

Personalised recommendations