Skip to main content
SpringerLink
Log in

LBP and Color Descriptors for Image Classification

  • Chapter
Book cover Cross Disciplinary Biometric Systems

Part of the book series: Intelligent Systems Reference Library ((ISRL,volume 37))

Abstract

Four novel color Local Binary Pattern (LBP) descriptors are presented in this chapter for scene image and image texture classification with applications to image search and retrieval. Specifically, the first color LBP descriptor, the oRGB-LBP descriptor, is derived by concatenating the LBP features of the component images in an opponent color space — the oRGB color space. The other three color LBP descriptors are obtained by the integration of the oRGB-LBP descriptor with some additional image features: the Color LBP Fusion (CLF) descriptor is constructed by integrating the RGB-LBP, the YCbCr-LBP, the HSV-LBP, the rgb-LBP, as well as the oRGB-LBP descriptor; the Color Grayscale LBP Fusion (CGLF) descriptor is derived by integrating the grayscale-LBP descriptor and the CLF descriptor; and the CGLF+PHOG descriptor is obtained by integrating the Pyramid of Histograms of Orientation Gradients (PHOG) and the CGLF descriptor. Feature extraction applies the Enhanced Fisher Model (EFM) and image classification is based on the nearest neighbor classification rule (EFM-NN). The proposed image descriptors and the feature extraction and classification methods are evaluated using three databases: the MIT scene database, the KTH-TIPS2-b database, and the KTH-TIPS materials database. The experimental results show that (i) the proposed oRGB-LBP descriptor improves image classification performance upon other color LBP descriptors, and (ii) the CLF, the CGLF, and the CGLF+PHOG descriptors further improve upon the oRGB-LBP descriptor for scene image and image texture classification.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Agarwal, S., Roth, D.: Learning a Sparse Representation for Object Detection. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part IV. LNCS, vol. 2353, pp. 113–127. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  2. Banerji, S., Verma, A., Liu, C.: Novel color LBP descriptors for scene and image texture classification. In: 15th Intl. Conf. on Image Processing, Computer Vision, and Pattern Recognition, July 18-21, Las Vegas, Nevada (2011)

    Google Scholar 

  3. Bay, H., Tuytelaars, T., Van Gool, L.: SURF: Speeded up robust features. Computer Vision and Image Understanding 110(3), 346–359 (2008)

    Article  Google Scholar 

  4. Bosch, A., Zisserman, A., Munoz, X.: Representing shape with a spatial pyramid kernel. In: Int. Conf. on Image and Video Retrieval, Amsterdam, The Netherlands, July 9-11, pp. 401–408 (2007)

    Google Scholar 

  5. Bosch, A., Zisserman, A., Munoz, X.: Scene classification using a hybrid generative/discriminative approach. IEEE Transactions on Pattern Analysis and Machine Intelligence 30(4), 712–727 (2008)

    Article  Google Scholar 

  6. Bratkova, M., Boulos, S., Shirley, P.: oRGB: A practical opponent color space for computer graphics. IEEE Computer Graphics and Applications 29(1), 42–55 (2009)

    Article  Google Scholar 

  7. Burghouts, G., Geusebroek, J.-M.: Performance evaluation of local color invariants. Computer Vision and Image Understanding 113, 48–62 (2009)

    Article  Google Scholar 

  8. Caputo, B., Hayman, E., Mallikarjuna, P.: Class-specific material categorisation. In: The Tenth IEEE International Conference on Computer Vision, Beijing, China, October 17-20, pp. 1597–1604 (2005)

    Google Scholar 

  9. Chen, J., Shan, S., He, C., Zhao, G., Pietikinen, M., Chen, X., Gao, W.: WLD: A robust local image descriptor. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(9), 1705–1720 (2010)

    Article  Google Scholar 

  10. Crosier, M., Griffin, L.D.: Texture classification with a dictionary of basic image features. In: Proc. Computer Vision and Pattern Recognition, Anchorage, Alaska, June 23-28, pp. 1–7 (2008)

    Google Scholar 

  11. Datta, R., Joshi, D., Li, J., Wang, J.: Image retrieval: Ideas, influences, and trends of the new age. ACM Computing Surveys 40(2), 509–522 (2008)

    Article  Google Scholar 

  12. Fergus, R., Perona, P., Zisserman, A.: Object class recognition by unsupervised scale-invariant learning. In: IEEE Conf. on Computer Vision and Pattern Recognition, Madison, Wisconsin, June 16-22, vol. 2, pp. 264–271 (2003)

    Google Scholar 

  13. Fukunaga, K.: Introduction to Statistical Pattern Recognition, 2nd edn. Academic Press (1990)

    Google Scholar 

  14. Gevers, T., van de Weijer, J., Stokman, H.: Color feature detection: An overview. In: Lukac, R., Plataniotis, K.N. (eds.) Color Image Processing: Methods and Applications. CRC Press, University of Toronto, Ontario, Canada (2006)

    Google Scholar 

  15. Gonzalez, R.C., Woods, R.E.: Digital Image Processing. Prentice Hall (2001)

    Google Scholar 

  16. Grauman, K., Darrell, T.: Pyramid match kernels: Discriminative classification with sets of image features. In: Int. Conference on Computer Vision, Beijing, October 17-20, vol. 2, pp. 1458–1465 (2005)

    Google Scholar 

  17. Hayman, E., Caputo, B., Fritz, M., Eklundh, J.-O.: On the Significance of Real-World Conditions for Material Classification. In: Pajdla, T., Matas, J.G. (eds.) ECCV 2004, Part IV. LNCS, vol. 3024, pp. 253–266. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  18. Jurie, F., Triggs, B.: Creating efficient codebooks for visual recognition. In: Int. Conference on Computer Vision, Beijing, October 17-20, pp. 604–610 (2005)

    Google Scholar 

  19. Kondra, S., Torre, V.: Texture classification using three circular filters. In: IEEE Indian Conf. on Computer Vision, Graphics and Image Processing, Bhubaneshwar, India, December 16-19, pp. 429–434 (2008)

    Google Scholar 

  20. Lazebnik, S., Schmid, C., Ponce, J.: Semi-local affine parts for object recognition. In: British Machine Vision Conference, London, September 7-9, vol. 2, pp. 959–968 (2004)

    Google Scholar 

  21. Leung, T.K., Malik, J.: Representing and recognizing the visual appearance of materials using three-dimensional textons. Int. Journal of Computer Vision 43(1), 29–44 (2001)

    Article  MATH  Google Scholar 

  22. Liu, C.: A Bayesian discriminating features method for face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 25(6), 725–740 (2003)

    Article  Google Scholar 

  23. Liu, C.: Enhanced independent component analysis and its application to content based face image retrieval. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 34(2), 1117–1127 (2004)

    Article  Google Scholar 

  24. Liu, C.: Gabor-based kernel PCA with fractional power polynomial models for face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(5), 572–581 (2004)

    Article  Google Scholar 

  25. Liu, C.: Capitalize on dimensionality increasing techniques for improving face recognition grand challenge performance. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(5), 725–737 (2006)

    Article  Google Scholar 

  26. Liu, C.: Learning the uncorrelated, independent, and discriminating color spaces for face recognition. IEEE Transactions on Information Forensics and Security 3(2), 213–222 (2008)

    Article  Google Scholar 

  27. Liu, C., Wechsler, H.: Evolutionary pursuit and its application to face recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(6), 570–582 (2000)

    Article  Google Scholar 

  28. Liu, C., Wechsler, H.: Robust coding schemes for indexing and retrieval from large face databases. IEEE Transactions on Image Processing 9(1), 132–137 (2000)

    Article  Google Scholar 

  29. Liu, C., Wechsler, H.: A shape and texture based enhanced Fisher classifier for face recognition. IEEE Transactions on Image Processing 10(4), 598–608 (2001)

    Article  MATH  Google Scholar 

  30. Liu, C., Wechsler, H.: Gabor feature based classification using the enhanced Fisher linear discriminant model for face recognition. IEEE Transactions on Image Processing 11(4), 467–476 (2002)

    Article  Google Scholar 

  31. Liu, C., Wechsler, H.: Independent component analysis of Gabor features for face recognition. IEEE Transactions on Neural Networks 14(4), 919–928 (2003)

    Article  Google Scholar 

  32. Liu, C., Yang, J.: ICA color space for pattern recognition. IEEE Transactions on Neural Networks 20(2), 248–257 (2009)

    Article  Google Scholar 

  33. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. Journal of Computer Vision 60(2), 91–110 (2004)

    Article  Google Scholar 

  34. Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(10), 1615–1630 (2005)

    Article  Google Scholar 

  35. Niblack, W., Barber, R., Equitz, W.: The QBIC project: Querying images by content using color, texture and shape. In: SPIE Conference on Geometric Methods in Computer Vision II, pp. 173–187 (1993)

    Google Scholar 

  36. Ojala, T., Pietikainen, M., Harwood, D.: Performance evaluation of texture measures with classification based on Kullback discrimination of distributions. In: Int. Conf. on Pattern Recognition, Jerusalem, Israel, pp. 582–585 (1994)

    Google Scholar 

  37. Ojala, T., Pietikainen, M., Harwood, D.: A comparative study of texture measures with classification based on feature distributions. Pattern Recognition 29(1), 51–59 (1996)

    Article  Google Scholar 

  38. Oliva, A., Torralba, A.: Modeling the shape of the scene: A holistic representation of the spatial envelope. Int. Journal of Computer Vision 42(3), 145–175 (2001)

    Article  MATH  Google Scholar 

  39. Pontil, M., Verri, A.: Support vector machines for 3D object recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(6), 637–646 (1998)

    Article  Google Scholar 

  40. Schiele, B., Crowley, J.: Recognition without correspondence using multidimensional receptive field histograms. Int. Journal of Computer Vision 36(1), 31–50 (2000)

    Article  Google Scholar 

  41. Shih, P., Liu, C.: Comparative assessment of content-based face image retrieval in different color spaces. International Journal of Pattern Recognition and Artificial Intelligence 19(7), 873–893 (2005)

    Article  Google Scholar 

  42. Smith, A.R.: Color gamut transform pairs. Computer Graphics 12(3), 12–19 (1978)

    Article  Google Scholar 

  43. Stokman, H., Gevers, T.: Selection and fusion of color models for image feature detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(3), 371–381 (2007)

    Article  Google Scholar 

  44. Swain, M.J., Ballard, D.H.: Color indexing. International Journal of Computer Vision 7(1), 11–32 (1991)

    Article  Google Scholar 

  45. Verma, A., Banerji, S., Liu, C.: A new color SIFT descriptor and methods for image category classification. In: International Congress on Computer Applications and Computational Science, Singapore, December 4-6, pp. 819–822 (2010)

    Google Scholar 

  46. Verma, A., Liu, C.: Novel EFM-KNN classifier and a new color descriptor for image classification. In: 20th IEEE Wireless and Optical Communications Conference (Multimedia Services and Applications), Newark, New Jersey, USA, April 15-16 (2011)

    Google Scholar 

  47. Weber, M., Welling, M., Perona, P.: Towards automatic discovery of object categories. In: IEEE Conf. on Computer Vision and Pattern Recognition, Hilton Head, SC, June 13-15, vol. 2, pp. 2101–2109 (2000)

    Google Scholar 

  48. Yang, J., Liu, C.: Color image discriminant models and algorithms for face recognition. IEEE Transactions on Neural Networks 19(12), 2088–2098 (2008)

    Article  Google Scholar 

  49. Zhang, J., Marszalek, M., Lazebnik, S., Schmid, C.: Local features and kernels for classification of texture and object categories: A comprehensive study. Int. Journal of Computer Vision 73(2), 213–238 (2007)

    Article  Google Scholar 

  50. Zhu, C., Bichot, C., Chen, L.: Multi-scale color local binary patterns for visual object classes recognition. In: Int. Conf. on Pattern Recognition, Istanbul, Turkey, August 23-26, pp. 3065–3068 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. New Jersey Institute of Technology, Newark, NJ, 07102, USA

    Sugata Banerji, Abhishek Verma & Chengjun Liu

Authors
  1. Sugata Banerji
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abhishek Verma
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chengjun Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sugata Banerji .

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer Berlin Heidelberg

About this chapter

Cite this chapter

Banerji, S., Verma, A., Liu, C. (2012). LBP and Color Descriptors for Image Classification. In: Cross Disciplinary Biometric Systems. Intelligent Systems Reference Library, vol 37. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28457-1_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-28457-1_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-28456-4

  • Online ISBN: 978-3-642-28457-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation