Advertisement

Texture Classification with Patch Autocorrelation Features

  • Radu Tudor IonescuEmail author
  • Andreea Lavinia Popescu
  • Dan Popescu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9489)

Abstract

Recently, a novel approach of capturing the autocorrelation of an image termed Patch Autocorrelation Features (PAF) was proposed. The PAF approach was successfully evaluated in a series of handwritten digit recognition experiments on the popular MNIST data set. However, the PAF representation has limited applications, because it is not invariant to affine transformations. In this work, the PAF approach is extended to become invariant to image transformations such as translation and rotation changes. First, several features are extracted from each image patch taken at a regular interval. Based on these features, a vector of similarity values is computed between each pair of patches. Then, the similarity vectors are clustered together such that the spatial offset between the patches of each pair is roughly the same. Finally, the mean and the standard deviation of each similarity value are computed for each group of similarity vectors. These statistics are concatenated in a feature vector called Translation and Rotation Invariant Patch Autocorrelation Features (TRIPAF). The TRIPAF vector essentially records information about the repeating patterns within an image at various spatial offsets. Several texture classification experiments are conducted on the Brodatz data set to evaluate the TRIPAF approach. The empirical results indicate that TRIPAF can improve the performance by up to \(10\,\%\) over a system that uses the same features, but extracts them from entire images. Furthermore, state of the art accuracy rates are obtained when the TRIPAF approach is combined with a scale invariant model, namely a bag of visual words model based on SIFT features.

Keywords

Patch-based method Texture classification Rotation invariance Translation invariance Kernel method Brodatz 

Notes

Acknowledgments

Dan Popescu has been funded by the National Research Program STAR, project 71/2013: Multisensory robotic system for aerial monitoring of critical infrastructure systems - MUROS. Andreea-Lavinia Popescu has been supported through the Financial Agreement POSDRU/159/1.5/S/134398.

References

  1. 1.
    Barnes, C., Goldman, D.B., Shechtman, E., Finkelstein, A.: The PatchMatch randomized matching algorithm for image manipulation. Commun. ACM 54(11), 103–110 (2011)CrossRefGoogle Scholar
  2. 2.
    Brochard, J., Khoudeir, M., Augereau, B.: Invariant feature extraction for 3D texture analysis using the autocorrelation function. Pattern Recogn. Lett. 22(6–7), 759–768 (2001)CrossRefzbMATHGoogle Scholar
  3. 3.
    Brodatz, P.: Textures: A Photographic Album For Artists And Designers. Dover Pictorial Archives. Dover Publications, New York (1966)Google Scholar
  4. 4.
    Cho, T.S., Avidan, S., Freeman, W.T.: The patch transform. IEEE Trans. Pattern Anal. Mach. Intell. 32(8), 1489–1501 (2010)CrossRefGoogle Scholar
  5. 5.
    Csurka, G., Dance, C.R., Fan, L., Willamowski, J., Bray, C.: Visual categorization with bags of keypoints. In: Workshop on Statistical Learning in Computer Vision, ECCV, pp. 1–22 (2004)Google Scholar
  6. 6.
    Deselaers, T., Keyser, D., Ney, H.: Discriminative training for object recognition using image patches. In: Proceedings of CVPR, pp. 157–162 (2005)Google Scholar
  7. 7.
    Gonen, M., Alpaydin, E.: Multiple kernel learning algorithms. J. Mach. Learn. Res. 12, 2211–2268 (2011)MathSciNetzbMATHGoogle Scholar
  8. 8.
    Haralick, R.M., Shanmugam, K., Dinstein, I.: Textural features for image classification. IEEE Trans. Syst. Man Cybern. 3(6), 610–621 (1973)CrossRefGoogle Scholar
  9. 9.
    Hastie, T., Tibshirani, R.: The Elements of Statistical Learning. Springer, New York (2003). Corrected ednzbMATHGoogle Scholar
  10. 10.
    Horikawa, Y.: Use of autocorrelation kernels in kernel canonical correlation analysis for texture classification. In: Pal, N.R., Kasabov, N., Mudi, R.K., Pal, S., Parui, S.K. (eds.) ICONIP 2004. LNCS, vol. 3316, pp. 1235–1240. Springer, Heidelberg (2004) CrossRefGoogle Scholar
  11. 11.
    Ionescu, R.T., Popescu, A.L., Popescu, D.: Patch autocorrelation features for optical character recognition. In: Proceedings of VISAPP, March 2015Google Scholar
  12. 12.
    Ionescu, R.T., Popescu, A.L., Popescu, M.: Texture classification with the PQ kernel. In: Proceedings of WSCG (2014)Google Scholar
  13. 13.
    Ionescu, R.T., Popescu, M., Grozea, C.: Local learning to improve bag of visual words model for facial expression recognition. In: Workshop on Challenges in Representation Learning, ICML (2013)Google Scholar
  14. 14.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Proceedings of NIPS, pp. 1106–1114 (2012)Google Scholar
  15. 15.
    Kuse, M., Wang, Y.F., Kalasannavar, V., Khan, M., Rajpoot, N.: Local isotropic phase symmetry measure for detection of beta cells and lymphocytes. J. Pathol. Inform. 2(2), 2 (2011)CrossRefGoogle Scholar
  16. 16.
    Lazebnik, S., Schmid, C., Ponce, J.: A sparse texture representation using local affine regions. IEEE Trans. Pattern Anal. Mach. Intell. 27(8), 1265–1278 (2005)CrossRefGoogle Scholar
  17. 17.
    Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of ICCV, vol. 2, pp. 1150–1157 (1999)Google Scholar
  18. 18.
    Nguyen, H.G., Fablet, R., Boucher, J.M.: Visual textures as realizations of multivariate log-Gaussian Cox processes. In: Proceedings of CVPR, pp. 2945–2952 (2011)Google Scholar
  19. 19.
    Perronnin, F., Sánchez, J., Mensink, T.: Improving the Fisher kernel for large-scale image classification. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part IV. LNCS, vol. 6314, pp. 143–156. Springer, Heidelberg (2010) CrossRefGoogle Scholar
  20. 20.
    Popescu, A.L., Popescu, D., Ionescu, R.T., Angelescu, N., Cojocaru, R.: Efficient fractal method for texture classification. In: Proceedings of ICSCS (2013)Google Scholar
  21. 21.
    Toyoda, T., Hasegawa, O.: Extension of higher order local autocorrelation features. Pattern Recogn. 40(5), 1466–1473 (2007)CrossRefzbMATHGoogle Scholar
  22. 22.
    Zhang, J., Marszalek, M., Lazebnik, S., Schmid, C.: Local features and kernels for classification of texture and object categories: a comprehensive study. Int. J. Comput. Vision 73(2), 213–238 (2007)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Radu Tudor Ionescu
    • 1
    Email author
  • Andreea Lavinia Popescu
    • 2
  • Dan Popescu
    • 2
  1. 1.University of BucharestBucharestRomania
  2. 2.Politehnica University of BucharestBucharestRomania

Personalised recommendations