Multimedia Tools and Applications

, Volume 78, Issue 23, pp 34027–34063 | Cite as

Hyper-spectral image segmentation using an improved PSO aided with multilevel fuzzy entropy

  • Rupak ChakrabortyEmail author
  • Rama Sushil
  • M. L. Garg


This paper proposes a novel histogram-based multi-level segmentation scheme of hyper-spectral images. In the proposed scheme an Improved Particle Swarm Optimization (IPSO) algorithm is implemented as a nature-inspired evolutionary algorithm to overcome the drawback of premature convergence and hence getting stuck in local optima problem of PSO. The high-dimension of PSO is decomposed into several one-dimensional problems and premature convergence is removed from each one-dimensional problem. This algorithm is further extended for replacing the worst particles by the fittest particles, determined by their fitness values. Multiple optimal threshold values have been evaluated based on fuzzy-entropy aided with the proposed algorithm. The performance of the IPSO is compared statistically with other global optimization algorithms namely Cuckoo Search (CS), Differential Evolution (DE), FireFly (FF), Genetic Algorithm (GA), and PSO. The produced segmented output of IPSO-fuzzy is then combined with the available ground truth values of image classes to train a Support Vector Machine (SVM) classifier via the composite kernel approach to improving the classification accuracy. This hybrid approach (IPSO-SVM) is then applied to popular hyper-spectral imageries acquired by AVRIS and ROSIS sensors. The final evaluated outcomes of the proposed scheme are also qualitatively compared to show its effectiveness over the other state-of-art global optimizers.


Improved particle swarm optimization (IPSO) Multilevel-thresholding Hyper-spectral imageries Fuzzy entropy Support vector machine (SVM) Composite kernel 



The authors would like to thank Mehmet Altan Toksöz, Student Member, IEEE, for helping by providing the color map information of ground-truth classes as source code and Prof. Jun Li, School of Geography and Planning, Sun Yat-Sen University, China for kindly providing the partial source codes of SVM-based the composite kernel used in this paper. The authors also would like to show their gratitude to Prof. P. Gamba and Prof. D. A. Landgrebe for kindly providing the data sets used in this paper.


  1. 1.
    Agrawal S, Panda R, Bhuyan S, Panigrahi BK (2013) Tsallis entropy based optimal multilevel thresholding using cuckoo search algorithm. Swarm Evol Comput 11:16–30Google Scholar
  2. 2.
    Akay B (2013) A study on particle swarm optimization and artificial bee colony algorithms for multilevel thresholding. Appl Soft Comput 13(6):3066–3091Google Scholar
  3. 3.
    Arifin AZ, Asano A (2006) Image segmentation by histogram thresholding using hierarchical cluster analysis. Pattern Recogn Lett 27(13):1515–1521Google Scholar
  4. 4.
    Arora S, Acharya J, Verma A, Panigrahi PK (2008) Multilevel thresholding for image segmentation through a fast statistical recursive algorithm. Pattern Recogn Lett 29(2):119–125Google Scholar
  5. 5.
    Baskar S, Alphones A, Suganthan P, Liang J (2005) Design of yagi–uda antennas using comprehensive learning particle swarm optimisation. IEE Proceedings-Microwaves, Antennas and Propagation 152(5):340–346Google Scholar
  6. 6.
    Bhandari AK, Singh VK, Kumar A, Singh GK (2014) Cuckoo search algorithm and wind driven optimization based study of satellite image segmentation for multilevel thresholding using Kapur’s entropy. Expert Syst Appl 41(7):3538–3560Google Scholar
  7. 7.
    Bhandari AK, Kumar A, Singh GK (2015) Modified artificial bee colony based computationally efficient multilevel thresholding for satellite image segmentation using Kapur’s, Otsu and Tsallis functions. Expert Syst Appl 42(3):1573–1601Google Scholar
  8. 8.
    Boskovitz V, Guterman H (2002) An adaptive neuro-fuzzy system for automatic image segmentation and edge detection. IEEE Trans Fuzzy Syst 10(2):247–262Google Scholar
  9. 9.
    Camps-Valls G, Bruzzone L (2005) Kernel-based methods for hyperspectral image classification. IEEE Trans Geosci Remote Sens 43(6):1351–1362Google Scholar
  10. 10.
    Camps-Valls G, Gomez-Chova L, Muñoz-Marí J, Vila-Francés J, Calpe-Maravilla J (2006) Composite kernels for hyperspectral image classification. IEEE Geosci Remote Sens Lett 3(1):93–97Google Scholar
  11. 11.
    Cao L, Bao P, Shi Z (2008) The strongest schema learning ga and its application to multilevel thresholding. Image Vis Comput 26(5):716–724Google Scholar
  12. 12.
    Chander A, Chatterjee A, Siarry P (2011) A new social and momentum component adaptive pso algorithm for image segmentation. Expert Syst Appl 38(5):4998–5004Google Scholar
  13. 13.
    Cheng HD, Sun Y (2000) A hierarchical approach to color image segmentation using homogeneity. IEEE Trans Image Process 9(12):2071–2082Google Scholar
  14. 14.
    Dong L, Yu G, Ogunbona P, Li W (2008) An efficient iterative algorithm for image thresholding. Pattern Recogn Lett 29(9):1311–1316Google Scholar
  15. 15.
    Du J (2008) Property of tsallis entropy and principle of entropy increase. arXiv:08023424
  16. 16.
    Fauvel M, Tarabalka Y, Benediktsson JA, Chanussot J, Tilton JC (2013) Advances in spectral-spatial classification of hyperspectral images. Proc IEEE 101(3):652–675Google Scholar
  17. 17.
    Gao H, Xu W, Sun J, Tang Y (2010) Multilevel thresholding for image segmentation through an improved quantum-behaved particle swarm algorithm. IEEE Trans Instrum Meas 59(4):934–946Google Scholar
  18. 18.
    Ghamisi P, Couceiro MS, Martins FM, Benediktsson JA (2014) Multilevel image segmentation based on fractional-order darwinian particle swarm optimization. IEEE Trans Geosci Remote Sens 52(5):2382–2394Google Scholar
  19. 19.
    Girshick R (2015) Fast r-cnn. In: Proceedings of the IEEE international conference on computer vision, pp 1440–1448Google Scholar
  20. 20.
    Hammouche K, Diaf M, Siarry P (2008) A multilevel automatic thresholding method based on a genetic algorithm for a fast image segmentation. Comput Vis Image Underst 109(2):163–175Google Scholar
  21. 21.
    Hammouche K, Diaf M, Siarry P (2010) A comparative study of various meta-heuristic techniques applied to the multilevel thresholding problem. Eng Appl Artif Intel 23(5):676–688Google Scholar
  22. 22.
    He K, Gkioxari G, Dollár P, Girshick R (2017) Mask r-cnn. In: Proceedings of the IEEE international conference on computer vision, pp 2961–2969Google Scholar
  23. 23.
    Horng MH (2011) Multilevel thresholding selection based on the artificial bee colony algorithm for image segmentation. Expert Syst Appl 38(11):13,785–13,791Google Scholar
  24. 24.
    Hughes G (1968) On the mean accuracy of statistical pattern recognizers. IEEE Trans Inf Theory 14(1):55–63Google Scholar
  25. 25.
    Kapur JN, Sahoo PK, Wong AK (1985) A new method for gray-level picture thresholding using the entropy of the histogram. Comput Vis Graph Image Process 29 (3):273–285Google Scholar
  26. 26.
    Karaboga D, Gorkemli B, Ozturk C, Karaboga N (2014) A comprehensive survey: artificial bee colony (abc) algorithm and applications. Artif Intell Rev 42(1):21–57Google Scholar
  27. 27.
    Kittler J, Illingworth J (1986) Minimum error thresholding. Pattern Recogn 19(1):41–47Google Scholar
  28. 28.
    Kurugollu F, Sankur B, Harmanci AE (2001) Color image segmentation using histogram multithresholding and fusion. Image Vis Comput 19(13):915–928Google Scholar
  29. 29.
    Li CH, Lee C (1993) Minimum cross entropy thresholding. Pattern Recogn 26(4):617–625Google Scholar
  30. 30.
    Li J, Bioucas-Dias JM, Plaza A (2012) Spectral–spatial hyperspectral image segmentation using subspace multinomial logistic regression and Markov random fields. IEEE Trans Geosci Remote Sens 50(3):809–823Google Scholar
  31. 31.
    Li J, Marpu PR, Plaza A, Bioucas-Dias JM, Benediktsson JA (2013) Generalized composite kernel framework for hyperspectral image classification. IEEE Trans Geosci Remote Sens 51(9):4816–4829Google Scholar
  32. 32.
    Li W, Wu G, Zhang F, Du Q (2017) Hyperspectral image classification using deep pixel-pair features. IEEE Trans Geosci Remote Sens 55(2):844–853Google Scholar
  33. 33.
    Li L, Wang C, Li W, Chen J (2018) Hyperspectral image classification by adaboost weighted composite kernel extreme learning machines. Neurocomputing 275:1725–1733Google Scholar
  34. 34.
    Li W, Feng F, Li H, Du Q (2018) Discriminant analysis-based dimension reduction for hyperspectral image classification: a survey of the most recent advances and an experimental comparison of different techniques. IEEE Geosci Remote Sens Mag 6 (1):15–34Google Scholar
  35. 35.
    Liang JJ, Qin AK, Suganthan PN, Baskar S (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans Evol Comput 10(3):281–295Google Scholar
  36. 36.
    Mughees A, Chen X, Tao L (2016) Unsupervised hyperspectral image segmentation: merging spectral and spatial information in boundary adjustment. In: 2016 55th Annual Conference of the Society of instrument and control engineers of Japan (SICE). IEEE, pp 1466–1471Google Scholar
  37. 37.
    Mukhopadhyay S, Banerjee S (2012) Global optimization of an optical chaotic system by chaotic multi swarm particle swarm optimization. Expert Syst Appl 39 (1):917–924Google Scholar
  38. 38.
    Naidu M, Kumar PR, Chiranjeevi K (2017) Shannon and fuzzy entropy based evolutionary image thresholding for image segmentation. Alexandria Engineering JournalGoogle Scholar
  39. 39.
    Nayak DR, Dash R, Majhi B (2018) Discrete ripplet-ii transform and modified pso based improved evolutionary extreme learning machine for pathological brain detection. Neurocomputing 282:232–247Google Scholar
  40. 40.
    Önüt S, Tuzkaya UR, Doǧaç B (2008) A particle swarm optimization algorithm for the multiple-level warehouse layout design problem. Comput Indu Engineering 54(4):783–799Google Scholar
  41. 41.
    Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9(1):62–66Google Scholar
  42. 42.
    Pal NR (1996) On minimum cross-entropy thresholding. Pattern Recogn 29 (4):575–580MathSciNetGoogle Scholar
  43. 43.
    Pare S, Bhandari AK, Kumar A, Singh GK, Khare S (2015) Satellite image segmentation based on different objective functions using genetic algorithm: a comparative study. In: 2015 IEEE International conference on digital signal processing (DSP). IEEE, pp 730–734Google Scholar
  44. 44.
    Pare S, Bhandari A, Kumar A, Singh G (2017) A new technique for multilevel color image thresholding based on modified fuzzy entropy and Lévy flight firefly algorithm. Computers & Electrical EngineeringGoogle Scholar
  45. 45.
    Perez A, Gonzalez RC (1987) An iterative thresholding algorithm for image segmentation. IEEE Trans Pattern Anal Mach Intell 6:742–751Google Scholar
  46. 46.
    Ratnaweera A, Halgamuge SK, Watson HC (2004) Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients. IEEE Trans Evol Comput 8(3):240–255Google Scholar
  47. 47.
    Revol C, Jourlin M (1997) A new minimum variance region growing algorithm for image segmentation. Pattern Recogn Lett 18(3):249–258Google Scholar
  48. 48.
    Sahoo PK, Arora G (2004) A thresholding method based on two-dimensional Renyi’s entropy. Pattern Recogn 37(6):1149–1161zbMATHGoogle Scholar
  49. 49.
    Sarkar S, Paul S, Burman R, Das S, Chaudhuri SS (2014) A fuzzy entropy based multi-level image thresholding using differential evolution. In: International conference on swarm, evolutionary, and memetic computing. Springer, pp 386–395Google Scholar
  50. 50.
    Sarkar S, Das S, Chaudhuri SS (2015) A multilevel color image thresholding scheme based on minimum cross entropy and differential evolution. Pattern Recogn Lett 54:27–35Google Scholar
  51. 51.
    Sarkar S, Das S, Chaudhuri SS (2016) Hyper-spectral image segmentation using Rényi entropy based multi-level thresholding aided with differential evolution. Expert Syst Appl 50:120–129Google Scholar
  52. 52.
    Sathya P, Kayalvizhi R (2010) Pso-based tsallis thresholding selection procedure for image segmentation. Int J. Comput Appl 5(4):39–46Google Scholar
  53. 53.
    Schölkopf B, Smola AJ (2002) Learning with kernels: support vector machines, regularization, optimization, and beyond. MIT PressGoogle Scholar
  54. 54.
    Sezgin M, Taşaltın R (2000) A new dichotomization technique to multilevel thresholding devoted to inspection applications. Pattern Recogn Lett 21(2):151–161Google Scholar
  55. 55.
    Sezgin M, et al. (2004) Survey over image thresholding techniques and quantitative performance evaluation. J Electron Imag 13(1):146–168Google Scholar
  56. 56.
    Suresh S, Lal S (2016) An efficient cuckoo search algorithm based multilevel thresholding for segmentation of satellite images using different objective functions. Expert Syst Appl 58:184–209Google Scholar
  57. 57.
    Tarabalka Y, Chanussot J, Benediktsson JA (2010) Segmentation and classification of hyperspectral images using watershed transformation. Pattern Recogn 43(7):2367–2379zbMATHGoogle Scholar
  58. 58.
    Toksöz MA, Ulusoy I (2016) Classification via ensembles of basic thresholding classifiers. IET Comput Vis 10(5):433–442Google Scholar
  59. 59.
    Toksöz MA, Ulusoy I (2016) Hyperspectral image classification via basic thresholding classifier. IEEE Trans Geosci Remote Sens 54(7):4039–4051Google Scholar
  60. 60.
    Van den Bergh F, Engelbrecht AP (2004) A cooperative approach to particle swarm optimization. IEEE Trans Evol Comput 8(3):225–239Google Scholar
  61. 61.
    Wang S, Chung Fl, Xiong F (2008) A novel image thresholding method based on parzen window estimate. Pattern Recogn 41(1):117–129zbMATHGoogle Scholar
  62. 62.
    Weszka JS (1978) A survey of threshold selection techniques. Comput Graph Image Process 7(2):259–265Google Scholar
  63. 63.
    Wong AK, Sahoo PK (1989) A gray-level threshold selection method based on maximum entropy principle. IEEE Trans Syst Man Cybern 19(4):866–871Google Scholar
  64. 64.
    Xu X, Li W, Ran Q, Du Q, Gao L, Zhang B (2018) Multisource remote sensing data classification based on convolutional neural network. IEEE Trans Geosci Remote Sens 56(2):937–949Google Scholar
  65. 65.
    Zahara E, Fan SKS, Tsai DM (2005) Optimal multi-thresholding using a hybrid optimization approach. Pattern Recogn Lett 26(8):1082–1095Google Scholar
  66. 66.
    Zhang M, Li W, Du Q (2017) Collaborative classification of hyperspectral and visible images with convolutional neural network. J Appl Remote Sens 11(4):042,607Google Scholar
  67. 67.
    Zhang M, Li W, Du Q (2018) Diverse region-based cnn for hyperspectral image classification. IEEE Trans Image Process 27(6):2623–2634MathSciNetzbMATHGoogle Scholar
  68. 68.
    Zheng H, Jie J, Hou B, Fei Z (2014) A multi-swarm particle swarm optimization algorithm for tracking multiple targets. In: 2014 IEEE 9th Conference on industrial electronics and applications (ICIEA). IEEE, pp 1662–1665Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringBennett UniversityGreater NoidaIndia
  2. 2.Department of Information TechnologyDIT UniversityDehradunIndia
  3. 3.Department of Computer Science and EngineeringDIT UniversityDehradunIndia

Personalised recommendations