Skip to main content

Stochastic Image Reconstruction from Local Histograms of Gradient Orientation

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 10302))

Abstract

Many image processing algorithms rely on local descriptors extracted around selected points of interest. Motivated by privacy issues, several authors have recently studied the possibility of image reconstruction from these descriptors, and proposed reconstruction methods performing local inference using a database of images. In this paper we tackle the problem of image reconstruction from local histograms of gradient orientation, obtained from simplified SIFT descriptors. We propose two reconstruction models based on Poisson editing and on the combination of multiscale orientation fields. These models are able to recover global shapes and many geometric details of images. They compare well to state of the art results, without requiring the use of any external database.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Morel, J.M., Yu, G.: ASIFT: a new framework for fully affine invariant image comparison. SIAM J. Imaging Sci. 2(2), 438–469 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  2. Attneave, F.: Some informational aspects of visual perception. Psychol. Rev. 61(3), 183 (1954)

    Article  Google Scholar 

  3. Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. PAMI 27(10), 1615–1630 (2005)

    Article  Google Scholar 

  4. Tuytelaars, T., Mikolajczyk, K.: Local invariant feature detectors: a survey. Found. Trends Comput. Graph. Vis. 3(3), 177–280 (2008)

    Article  Google Scholar 

  5. Ojala, T., Pietikinen, M., Menp, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. PAMI 24(7), 971–987 (2002)

    Article  Google Scholar 

  6. Lowe, D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  7. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of the IEEE CVPR, vol. 1, pp. 886–893 (2005)

    Google Scholar 

  8. Sivic, J., Zisserman, A.: Video Google: a text retrieval approach to object matching in videos. In: Proceedings of the IEEE ICCV, pp. 1470–1477 (2003)

    Google Scholar 

  9. Weinzaepfel, P., Jégou, H., Pérez, P.: Reconstructing an image from its local descriptors. In: Proceedings of the IEEE CVPR, pp. 337–344 (2011)

    Google Scholar 

  10. Vondrick, C., Khosla, A., Malisiewicz, T., Torralba, A.: Hoggles: visualizing object detection features. In: Proceedings of the IEEE ICCV, pp. 1–8 (2013)

    Google Scholar 

  11. d’Angelo, E., Jacques, L., Alahi, A., Vandergheynst, P.: From bits to images: inversion of local binary descriptors. IEEE Trans. PAMI 36(5), 874–887 (2014)

    Article  Google Scholar 

  12. Kato, H., Harada, T.: Image reconstruction from bag-of-visual-words. In: Proceedings of the IEEE CVPR, pp. 955–962 (2014)

    Google Scholar 

  13. Dosovitskiy, A., Brox, T.: Inverting Visual Representations with Convolutional Networks. arXiv:1506.02753 [cs] (2015)

  14. Mahendran, A., Vedaldi, A.: Understanding deep image representations by inverting them. In: IEEE CVPR, pp. 5188–5196 (2015)

    Google Scholar 

  15. Mahendran, A., Vedaldi, A.: Visualizing deep convolutional neural networks using natural pre-images. Int. J. Comput. Vis. 120(3), 233–255 (2016)

    Article  MathSciNet  Google Scholar 

  16. Desolneux, A.: When the a contrario approach becomes generative. Int. J. Comput. Vis. 116(1), 46–65 (2016)

    Article  MathSciNet  Google Scholar 

  17. Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. In: ACM SIGGRAPH 2003 Papers. SIGGRAPH 2003, pp. 313–318 (2003)

    Google Scholar 

  18. Zhu, S., Wu, Y., Mumford, D.: Filters, random fields and maximum entropy (FRAME): towards a unified theory for texture modeling. Int. J. Comput. Vis. 27(2), 107–126 (1998)

    Article  Google Scholar 

  19. Mumford, D., Desolneux, A.: Pattern Theory: The Stochastic Analysis of Real-World Signals. A K Peters/CRC Press, Natick (2010)

    MATH  Google Scholar 

  20. Rey Otero, I., Delbracio, M.: Anatomy of the SIFT method. Image Process. On Line 4, 370–396 (2014)

    Article  Google Scholar 

  21. Nesterov, Y.: Introductory Lectures on Convex Optimization: A Basic Course, vol. 87. Springer, Boston (2004)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Agnès Desolneux .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Desolneux, A., Leclaire, A. (2017). Stochastic Image Reconstruction from Local Histograms of Gradient Orientation. In: Lauze, F., Dong, Y., Dahl, A. (eds) Scale Space and Variational Methods in Computer Vision. SSVM 2017. Lecture Notes in Computer Science(), vol 10302. Springer, Cham. https://doi.org/10.1007/978-3-319-58771-4_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-58771-4_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-58770-7

  • Online ISBN: 978-3-319-58771-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics