Abstract
Many image processing algorithms rely on local descriptors extracted around selected points of interest. Motivated by privacy issues, several authors have recently studied the possibility of image reconstruction from these descriptors, and proposed reconstruction methods performing local inference using a database of images. In this paper we tackle the problem of image reconstruction from local histograms of gradient orientation, obtained from simplified SIFT descriptors. We propose two reconstruction models based on Poisson editing and on the combination of multiscale orientation fields. These models are able to recover global shapes and many geometric details of images. They compare well to state of the art results, without requiring the use of any external database.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Morel, J.M., Yu, G.: ASIFT: a new framework for fully affine invariant image comparison. SIAM J. Imaging Sci. 2(2), 438–469 (2009)
Attneave, F.: Some informational aspects of visual perception. Psychol. Rev. 61(3), 183 (1954)
Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. PAMI 27(10), 1615–1630 (2005)
Tuytelaars, T., Mikolajczyk, K.: Local invariant feature detectors: a survey. Found. Trends Comput. Graph. Vis. 3(3), 177–280 (2008)
Ojala, T., Pietikinen, M., Menp, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. PAMI 24(7), 971–987 (2002)
Lowe, D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of the IEEE CVPR, vol. 1, pp. 886–893 (2005)
Sivic, J., Zisserman, A.: Video Google: a text retrieval approach to object matching in videos. In: Proceedings of the IEEE ICCV, pp. 1470–1477 (2003)
Weinzaepfel, P., Jégou, H., Pérez, P.: Reconstructing an image from its local descriptors. In: Proceedings of the IEEE CVPR, pp. 337–344 (2011)
Vondrick, C., Khosla, A., Malisiewicz, T., Torralba, A.: Hoggles: visualizing object detection features. In: Proceedings of the IEEE ICCV, pp. 1–8 (2013)
d’Angelo, E., Jacques, L., Alahi, A., Vandergheynst, P.: From bits to images: inversion of local binary descriptors. IEEE Trans. PAMI 36(5), 874–887 (2014)
Kato, H., Harada, T.: Image reconstruction from bag-of-visual-words. In: Proceedings of the IEEE CVPR, pp. 955–962 (2014)
Dosovitskiy, A., Brox, T.: Inverting Visual Representations with Convolutional Networks. arXiv:1506.02753 [cs] (2015)
Mahendran, A., Vedaldi, A.: Understanding deep image representations by inverting them. In: IEEE CVPR, pp. 5188–5196 (2015)
Mahendran, A., Vedaldi, A.: Visualizing deep convolutional neural networks using natural pre-images. Int. J. Comput. Vis. 120(3), 233–255 (2016)
Desolneux, A.: When the a contrario approach becomes generative. Int. J. Comput. Vis. 116(1), 46–65 (2016)
Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. In: ACM SIGGRAPH 2003 Papers. SIGGRAPH 2003, pp. 313–318 (2003)
Zhu, S., Wu, Y., Mumford, D.: Filters, random fields and maximum entropy (FRAME): towards a unified theory for texture modeling. Int. J. Comput. Vis. 27(2), 107–126 (1998)
Mumford, D., Desolneux, A.: Pattern Theory: The Stochastic Analysis of Real-World Signals. A K Peters/CRC Press, Natick (2010)
Rey Otero, I., Delbracio, M.: Anatomy of the SIFT method. Image Process. On Line 4, 370–396 (2014)
Nesterov, Y.: Introductory Lectures on Convex Optimization: A Basic Course, vol. 87. Springer, Boston (2004)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Desolneux, A., Leclaire, A. (2017). Stochastic Image Reconstruction from Local Histograms of Gradient Orientation. In: Lauze, F., Dong, Y., Dahl, A. (eds) Scale Space and Variational Methods in Computer Vision. SSVM 2017. Lecture Notes in Computer Science(), vol 10302. Springer, Cham. https://doi.org/10.1007/978-3-319-58771-4_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-58771-4_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-58770-7
Online ISBN: 978-3-319-58771-4
eBook Packages: Computer ScienceComputer Science (R0)