Multimedia Tools and Applications

, Volume 78, Issue 24, pp 34513–34539 | Cite as

A structural based feature extraction for detecting the relation of hidden substructures in coral reef images

  • Mahmood SotoodehEmail author
  • Mohammad Reza Moosavi
  • Reza Boostani


In this paper, we present an efficient approach to extract local structural color texture features for classifying coral reef images. Two local texture descriptors are derived from this approach. The first one, based on Median Robust Extended Local Binary Pattern (MRELBP), is called Color MRELBP (CMRELBP). CMRELBP is very accurate and can capture the structural information from color texture images. To reduce the dimensionality of the feature vector, the second descriptor, co-occurrence CMRELBP (CCMRELBP) is introduced. It is constructed by applying the Integrative Co-occurrence Matrix (ICM) on the Color MRELBP images. This way we can detect and extract the relative relations between structural texture patterns. Moreover, we propose a multiscale LBP based approach with these two schemes to capture microstructure and macrostructure texture information. The experimental results on coral reef (EILAT, EILAT2, RSMAS, and MLC) and four well-known texture datasets (OUTEX, KTH-TIPS, CURET, and UIUCTEX) show that the proposed scheme is quite effective in designing an accurate, robust to noise, rotation and illumination invariant texture classification system. Moreover, it makes an admissible tradeoff between accuracy and number of features.


Color texture descriptors Coral reef images Integrative co-occurrence matrix (ICM) Local binary pattern (LBP) Feature extraction Macrostructure texture information 



The authors of this paper express their deepest gratitude to the late Dr. Farshad Tajeripour, who paved the road for Mahmood Sotoodeh with unwavering support in the early stages of his Ph.D. thesis. We offer our deepest condolences to his family and know that God welcomes his soul to a heavenly place.


  1. 1.
    Bala A, Kaur T (2016) Local texton XOR patterns: A new feature descriptor for content-based image retrieval. Engineering Science and Technology, an International Journal 19(1):101–112CrossRefGoogle Scholar
  2. 2.
    Beijbom O, Edmunds PJ, Kline DI, Mitchell BG, Kriegman D (2012) Automated annotation of coral reef survey images. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, IEEE, pp 1170–1177Google Scholar
  3. 3.
    Bewley M, Douillard B, Nourani-Vatani N, Friedman A, Pizarro O, Williams S (2012) Automated species detection: An experimental approach to kelp detection from sea-floor AUV images. In: Proc Australas Conf Rob AutomGoogle Scholar
  4. 4.
    Bewley M, Nourani-Vatani N, Rao D, Douillard B, Pizarro O, Williams SB (2015) Hierarchical classification in AUV imagery. In: Field and service robotics. Springer, pp 3–16Google Scholar
  5. 5.
    Bianconi F, Harvey RW, Southam P, Fernández A (2011) Theoretical and experimental comparison of different approaches for color texture classification. Journal of Electronic Imaging 20(4):043006CrossRefGoogle Scholar
  6. 6.
    Blanchet J-N, Déry S, Landry J-A, Osborne K (2016) Automated annotation of corals in natural scene images using multiple texture representations. PeerJ Preprints 4:e2026v2022Google Scholar
  7. 7.
    Caputo B, Hayman E, Fritz M, Eklundh J-O (2010) Classifying materials in the real world. Image Vis Comput 28(1):150–163CrossRefGoogle Scholar
  8. 8.
    Dharma D (2018) Coral reef image/video classification employing novel octa-angled pattern for triangular sub region and pulse coupled convolutional neural network (PCCNN). Multimed Tools Appl 77(24):31545–31579CrossRefGoogle Scholar
  9. 9.
    Elawady M (2015) Sparse coral classification using deep convolutional neural networks. arXiv preprint arXiv:151109067Google Scholar
  10. 10.
    Fathi A, Naghsh-Nilchi AR (2012) Noise tolerant local binary pattern operator for efficient texture analysis. Pattern Recogn Lett 33(9):1093–1100CrossRefGoogle Scholar
  11. 11.
    Gómez-Ríos A, Tabik S, Luengo J, Shihavuddin A, Krawczyk B, Herrera F (2019) Towards highly accurate coral texture images classification using deep convolutional neural networks and data augmentation. Expert Syst Appl 118:315–328CrossRefGoogle Scholar
  12. 12.
    Guo Z, Zhang L, Zhang D (2010) A completed modeling of local binary pattern operator for texture classification. IEEE Trans Image Process 19(6):1657–1663MathSciNetzbMATHCrossRefGoogle Scholar
  13. 13.
    Haralick RM, Shanmugam K, Dinstein IH (1973) Textural features for image classification. IEEE Transactions on Systems, Man, and Cybernetics 3(6):610–621CrossRefGoogle Scholar
  14. 14.
    Hayman E, Caputo B, Fritz M, Eklundh J-O (2004) On the significance of real-world conditions for material classification. In: European conference on computer vision. Springer, pp 253–266Google Scholar
  15. 15.
    He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778Google Scholar
  16. 16.
    Heikkilä M, Pietikäinen M, Schmid C (2009) Description of interest regions with local binary patterns. Pattern Recogn 42(3):425–436zbMATHCrossRefGoogle Scholar
  17. 17.
    Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708Google Scholar
  18. 18.
    Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105Google Scholar
  19. 19.
    Lazebnik S, Schmid C, Ponce J (2005) A sparse texture representation using local affine regions. IEEE Trans Pattern Anal Mach Intell 27(8):1265–1278CrossRefGoogle Scholar
  20. 20.
    LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRefGoogle Scholar
  21. 21.
    Liao S, Law MW, Chung AC (2009) Dominant local binary patterns for texture classification. IEEE Trans Image Process 18(5):1107–1118MathSciNetzbMATHCrossRefGoogle Scholar
  22. 22.
    Liu L, Lao S, Fieguth PW, Guo Y, Wang X, Pietikäinen M (2016) Median robust extended local binary pattern for texture classification. IEEE Trans Image Process 25(3):1368–1381MathSciNetzbMATHCrossRefGoogle Scholar
  23. 23.
    Liu L, Long Y, Fieguth PW, Lao S, Zhao G (2014) BRINT: binary rotation invariant and noise tolerant texture classification. IEEE Trans Image Process 23(7):3071–3084MathSciNetzbMATHCrossRefGoogle Scholar
  24. 24.
    Liu GH, Yang JY (2013) Content-based image retrieval using color difference histogram. Pattern Recogn 46(1):188–198CrossRefGoogle Scholar
  25. 25.
    Liu L, Zhao L, Long Y, Kuang G, Fieguth P (2012) Extended local binary patterns for texture classification. Image Vis Comput 30(2):86–99CrossRefGoogle Scholar
  26. 26.
    Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRefGoogle Scholar
  27. 27.
    Loya Y (2004) The coral reefs of Eilat—past, present and future: three decades of coral community structure studies. In: Coral health and disease. Springer, pp 1–34Google Scholar
  28. 28.
    Mahmood A, Bennamoun M, An S, Sohel F, Boussaid F, Hovey R, Kendrick G, Fisher R (2016) Automatic annotation of coral reefs using deep learning. In: Oceans 2016 mts/IEEE monterey, IEEE, pp 1–5Google Scholar
  29. 29.
    Mahmood A, Bennamoun M, An S, Sohel F, Boussaid F, Hovey R, Kendrick G, Fisher R (2016) Coral classification with hybrid feature representations. In: 2016 IEEE International Conference on Image Processing (ICIP), IEEE, pp 519–523Google Scholar
  30. 30.
    Manjunath BS, Ma W-Y (1996) Texture features for browsing and retrieval of image data. IEEE Trans Pattern Anal Mach Intell 18(8):837–842CrossRefGoogle Scholar
  31. 31.
    Manjunath BS, Ohm J-R, Vasudevan VV, Yamada A (2001) Color and texture descriptors. IEEE Transactions on Circuits and Systems for Video Technology 11(6):703–715CrossRefGoogle Scholar
  32. 32.
    Marcos MSA, David L, Peñaflor E, Ticzon V, Soriano M (2008) Automated benthic counting of living and non-living components in Ngedarrak Reef, Palau via subsurface underwater video. Environ Monit Assess 145(1–3):177–184CrossRefGoogle Scholar
  33. 33.
    Mary NAB, Dejey D (2018) Classification of Coral Reef Submarine Images and Videos Using a Novel Z with Tilted Z Local Binary Pattern (Z⊕ TZLBP). Wirel Pers Commun 98(3):2427–2459CrossRefGoogle Scholar
  34. 34.
    Mary NAB, Dharma D (2017) Coral reef image classification employing improved LDP for feature extraction. J Vis Commun Image Represent 49:225–242CrossRefGoogle Scholar
  35. 35.
    Mary NAB, Dharma D (2018) A novel framework for real-time diseased coral reef image classification. Multimed Tools Appl:1–39Google Scholar
  36. 36.
    Ojala T (1997) Nonparametric texture analysis using simple spatial operators, with applications in visual inspection. Dissertation, Acta Univ Oul C 105, Department of Electrical Engineering, University of Oulu, Finland 105Google Scholar
  37. 37.
    Ojala T, Maenpaa T, Pietikainen M, Viertola J, Kyllonen J, Huovinen S (2002) Outex-new framework for empirical evaluation of texture analysis algorithms. In: Object recognition supported by user interaction for service robots. IEEE, pp 701–706Google Scholar
  38. 38.
    Ojala T, Pietikäinen M, Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Pattern Recogn 29(1):51–59CrossRefGoogle Scholar
  39. 39.
    Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987zbMATHCrossRefGoogle Scholar
  40. 40.
    Padmavathi G, Muthukumar M, Thakur SK (2010) Kernel principal component analysis feature detection and classification for underwater images. In: 2010 3rd International Congress on Image and Signal Processing, IEEE, pp 983–988Google Scholar
  41. 41.
    Palm C (2004) Color texture classification by integrative co-occurrence matrices. Pattern Recogn 37(5):965–976CrossRefGoogle Scholar
  42. 42.
    Pican N, Trucco E, Ross M, Lane D, Petillot Y, Ruiz IT (1998) Texture analysis for seabed classification: co-occurrence matrices vs. self-organizing maps. In: IEEE Oceanic Engineering Society. OCEANS'98. Conference Proceedings (Cat. No. 98CH36259), IEEE, pp 424–428Google Scholar
  43. 43.
    Pietikäinen M, Ojala T, Xu Z (2000) Rotation-invariant texture classification using feature distributions. Pattern Recogn 33(1):43–52CrossRefGoogle Scholar
  44. 44.
    Pizarro O, Rigby P, Johnson-Roberson M, Williams SB, Colquhoun J (2008) Towards image-based marine habitat classification. In: OCEANS 2008, IEEE, pp 1–7Google Scholar
  45. 45.
    Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M (2015) Imagenet large scale visual recognition challenge. Int J Comput Vis 115(3):211–252MathSciNetCrossRefGoogle Scholar
  46. 46.
    Sabins FF (2007) Remote sensing: principles and applications. Waveland Press, Long GroveGoogle Scholar
  47. 47.
    Shakoor MH, Boostani R (2018) A novel advanced local binary pattern for image-based coral reef classification. Multimed Tools Appl 77(2):2561–2591CrossRefGoogle Scholar
  48. 48.
    Shakoor MH, Boostani R (2018) Radial mean local binary pattern for noisy texture classification. Multimed Tools Appl 77(16):21481–21508. CrossRefGoogle Scholar
  49. 49.
    Shihavuddin A (2017) Coral reef dataset, v2. 10.17632/86y667257h.2#file-5a2847d2-4c9f-41a9-8d7c-cdc74a0195c2Google Scholar
  50. 50.
    Shihavuddin A, Gracias N, Garcia R, Gleason A, Gintert B (2013) Image-based coral reef classification and thematic mapping. Remote Sens 5(4):1809–1841CrossRefGoogle Scholar
  51. 51.
    Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:14091556Google Scholar
  52. 52.
    Sotoodeh M, Moosavi MR, Boostani R (2019) A Novel Adaptive LBP-Based Descriptor for Color Image Retrieval. Expert Syst ApplGoogle Scholar
  53. 53.
    Stokes MD, Deane GB (2009) Automated processing of coral reef benthic images. Limnol Oceanogr Methods 7(2):157–168CrossRefGoogle Scholar
  54. 54.
    Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2818–2826Google Scholar
  55. 55.
    Tan X, Triggs W (2010) Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans Image Process 19(6):1635–1650MathSciNetzbMATHCrossRefGoogle Scholar
  56. 56.
    Tusa E, Reynolds A, Lane DM, Robertson NM, Villegas H, Bosnjak A (2014) Implementation of a fast coral detector using a supervised machine learning and gabor wavelet feature descriptors. In: 2014 IEEE Sensor Systems for a Changing Ocean (SSCO). IEEE, pp 1–6Google Scholar
  57. 57.
    Zhang B, Gao Y, Zhao S, Liu J (2010) Local derivative pattern versus local binary pattern: face recognition with high-order local pattern descriptor. IEEE Trans Image Process 19(2):533–544MathSciNetzbMATHCrossRefGoogle Scholar
  58. 58.
    Zhang J, Marszałek M, Lazebnik S, Schmid C (2007) Local features and kernels for classification of texture and object categories: A comprehensive study. Int J Comput Vis 73(2):213–238CrossRefGoogle Scholar
  59. 59.
    Zhao Y, Jia W, Hu R-X, Min H (2013) Completed robust local binary pattern for texture classification. Neurocomputing 106:68–76CrossRefGoogle Scholar
  60. 60.
    Zhu Z, You X, Chen CP, Tao D, Ou W, Jiang X, Zou J (2015) An adaptive hybrid pattern for noise-robust texture analysis. Pattern Recogn 48(8):2592–2608CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  • Mahmood Sotoodeh
    • 1
    • 2
    Email author
  • Mohammad Reza Moosavi
    • 1
  • Reza Boostani
    • 1
  1. 1.Department of Electrical and Computer EngineeringShiraz UniversityShirazIran
  2. 2.Department of Computer ScienceUtah State UniversityLoganUSA

Personalised recommendations