Advertisement

Applied Intelligence

, Volume 49, Issue 3, pp 1036–1062 | Cite as

A chaotic teaching learning based optimization algorithm for clustering problems

  • Yugal KumarEmail author
  • Pradeep Kumar Singh
Article
  • 95 Downloads

Abstract

This paper presents a teaching learning based algorithm for solving optimization problems. This algorithm is inspired through classroom teaching pattern either students can learn from teachers or from other students. But, the teaching learning based optimization (TLBO) algorithm suffers with premature convergence and lack of tradeoff between local search and global search. Hence, to address the above mentioned shortcomings of TLBO algorithm, a chaotic version of TLBO algorithm is proposed with different chaotic mechanisms. Further, a local search method is also incorporated for effective tradeoff between local and global search and also to improve the quality of solution. The performance of proposed algorithm is evaluated on some benchmark test functions taken from Congress on Evolutionary Computation 2014 (CEC’14). The results revealed that proposed algorithm provides better and effective results to solve benchmark test functions. Moreover, the proposed algorithm is also applied to solve clustering problems. It is found that proposed algorithm gives better clustering results in comparison to other algorithms.

Keywords

Teaching learning -based optimization Clustering Meta-heuristics Numerical function optimization 

Notes

Compliance with Ethical Standards

Conflict of interests

There is no conflict of interest.

References

  1. 1.
    Stützle T (1998) Local search algorithms for combinatorial problems. Darmstadt University of Technology PhD Thesis, p 20Google Scholar
  2. 2.
    Kirkpatrick S, Gelatt CD, Vecchi MP (1983) Optimization by simulated annealing. Science 220 (4598):671–680MathSciNetzbMATHGoogle Scholar
  3. 3.
    Holland JH (1992) Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence. MIT PressGoogle Scholar
  4. 4.
    Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proceedings of the sixth IEEE international symposium on micro machine and human science, pp 39–43Google Scholar
  5. 5.
    Dorigo M, Birattari M, Stutzle T (2006) Ant colony optimization. IEEE Comput Intell Mag 1(4):28–39Google Scholar
  6. 6.
    Lee KS, Geem ZW (2004) A new structural optimization method based on the harmony search algorithm. Comput Struct 82(9-10):781–798Google Scholar
  7. 7.
    Karaboğa D, Baştürk B (2007) Artificial bee colony (ABC) optimization algorithm for solving constrained optimization problems. LNCS: Ad Soft Comput: Found Fuzzy Logic Soft Comput 4529:789–798zbMATHGoogle Scholar
  8. 8.
    Yang XS (2009) Firefly algorithms for multimodal optimization. In: International symposium on stochastic algorithms. Springer, Berlin, pp 169–178Google Scholar
  9. 9.
    Kashan AH (2011) An efficient algorithm for constrained global optimization and application to mechanical engineering design: league championship algorithm (LCA). Comput Aided Des 43(12):1769–1792Google Scholar
  10. 10.
    Eskandar H, Sadollah A, Bahreininejad A, Hamdi M (2012) Water cycle algorithm–A novel metaheuristic optimization method for solving constrained engineering optimization problems. Comput Struct 110:151–166Google Scholar
  11. 11.
    Kaveh A, Talatahari S (2010) A novel heuristic optimization method: charged system search. Acta Mech 213(3-4):267–289zbMATHGoogle Scholar
  12. 12.
    Kumar Y, Sahoo G (2014) A charged system search approach for data clustering. Progress Artif Intell 2(2-3):153–166Google Scholar
  13. 13.
    Kaveh A, Share MAM, Moslehi M (2013) Magnetic charged system search: a new meta-heuristic algorithm for optimization. Acta Mech 224(1):85–107zbMATHGoogle Scholar
  14. 14.
    Kumar Y, Sahoo G (2015) Hybridization of magnetic charge system search and particle swarm optimization for efficient data clustering using neighborhood search strategy. Soft Comput 19(12):3621–3645Google Scholar
  15. 15.
    Kumar Y, Gupta S, Kumar D, Sahoo G (2016) A clustering approach based on charged particles. In: Optimization algorithms-methods and applications. InTechGoogle Scholar
  16. 16.
    Rao R, Savsani VJ, Vakharia DP (2011) Teaching–learning-based optimization: a novel method for constrained mechanical design optimization problems. Comput Aided Des 43(3):303–315Google Scholar
  17. 17.
    Sahoo AJ, Kumar Y (2014) Modified teacher learning based optimization method for data clustering. In: Advances in signal processing and intelligent recognition systems. Springer, Cham, pp 429–437Google Scholar
  18. 18.
    Sadollah A, Bahreininejad A, Eskandar H, Hamdi M (2013) Mine blast algorithm: a new population based algorithm for solving constrained engineering optimization problems. Appl Soft Comput 13(5):2592–2612Google Scholar
  19. 19.
    Dos Santos Coelho L, Mariani VC (2008) Use of chaotic sequences in a biologically inspired algorithm for engineering design optimization. Expert Syst Appl 34(3):1905–1913Google Scholar
  20. 20.
    Talatahari S, Azar BF, Sheikholeslami R, Gandomi AH (2012) Imperialist competitive algorithm combined with chaos for global optimization. Commun Nonlinear Sci Numer Simul 17(3):1312–1319MathSciNetzbMATHGoogle Scholar
  21. 21.
    Tavazoei MS, Haeri M (2007) Comparison of different one-dimensional maps as chaotic search pattern in chaos optimization algorithms. Appl Math Comput 187(2):1076–1085MathSciNetzbMATHGoogle Scholar
  22. 22.
    Gharooni-fard G, Moein-darbari F, Deldari H, Morvaridi A (2010) Scheduling of scientific workflows using a chaos-genetic algorithm. Procedia Comput Sci 1(1):1445–1454Google Scholar
  23. 23.
    Alatas B (2010) Chaotic harmony search algorithms. Appl Math Comput 216(9):2687–2699zbMATHGoogle Scholar
  24. 24.
    Mingjun J, Huanwen T (2004) Application of chaos in simulated annealing. Chaos Solitons Fractals 21(4):933–941zbMATHGoogle Scholar
  25. 25.
    Alatas B, Akin E, Ozer AB (2009) Chaos embedded particle swarm optimization algorithms. Chaos Solitons Fractals 40(4):1715–1734MathSciNetzbMATHGoogle Scholar
  26. 26.
    Talatahari S, Azar BF, Sheikholeslami R, Gandomi AH (2012) Imperialist competitive algorithm combined with chaos for global optimization. Commun Nonlinear Sci Numer Simul 17(3):1312–1319MathSciNetzbMATHGoogle Scholar
  27. 27.
    Gong W, Wang S (2009) Chaos ant colony optimization and application. In: 2009 Fourth International conference on internet computing for science and engineering (ICICSE). IEEE, pp 301–303Google Scholar
  28. 28.
    Alatas B (2010) Chaotic bee colony algorithms for global numerical optimization. Expert Syst Appl 37(8):5682–5687Google Scholar
  29. 29.
    Alatas B (2011) Uniform big bang–chaotic big crunch optimization. Commun Nonlinear Sci Numer Simul 16(9):3696–3703zbMATHGoogle Scholar
  30. 30.
    Kumar Y, Sahoo G (2014) A chaotic charged system search approach for data clustering. Informatica 38(3):249–261MathSciNetGoogle Scholar
  31. 31.
    Rao R, Savsani VJ, Balic J (2012) Teaching–learning-based optimization algorithm for unconstrained and constrained real-parameter optimization problems. Eng Optim 44(12):1447–1462Google Scholar
  32. 32.
    Rao R, Savsani VJ, Vakharia DP (2012) Teaching–learning-based optimization: an optimization method for continuous non-linear large scale problems. Inform Sci 183(1):1–15MathSciNetGoogle Scholar
  33. 33.
    Zhile YANG, Kang LI, Qun NIU, Yusheng XUE, Foley A (2014) A self-learning TLBO based dynamic economic/environmental dispatch considering multiple plug-in electric vehicle loads. J Modern Power Syst Clean Energy 2(4):298–307Google Scholar
  34. 34.
    Chen CH (2013) Group leader dominated teaching-learning based optimization. In: 2013 international conference on parallel and distributed computing, applications and technologies (PDCAT). IEEE, pp 304–308Google Scholar
  35. 35.
    Yang Z, Li K, Foley A, Zhang C (2014) A new self-learning TLBO algorithm for RBF neural modelling of batteries in electric vehicles. In: 2014 IEEE congress on evolutionary computation (CEC). IEEE, pp 2685–2691Google Scholar
  36. 36.
    Sahoo AJ, Kumar Y (2014) Modified teacher learning based optimization method for data clustering. In: Advances in signal processing and intelligent recognition systems. Springer, Cham, pp 429–437Google Scholar
  37. 37.
    Rao R, Patel V (2013) An improved teaching-learning-based optimization algorithm for solving unconstrained optimization problems. Scientia Iranica 20(3):710–720Google Scholar
  38. 38.
    Satapathy SC, Naik A (2014) Modified teaching–learning-based optimization algorithm for global numerical optimization—a comparative study. Swarm Evol Compu 16:28–37Google Scholar
  39. 39.
    Huang J, Gao L, Li X (2015) An effective teaching-learning-based cuckoo search algorithm for parameter optimization problems in structure designing and machining processes. Appl Soft Comput 36:349–356Google Scholar
  40. 40.
    Zou F, Wang L, Hei X, Chen D (2015) Teaching–learning-based optimization with learning experience of other learners and its application. Appl Soft Comput 37:725–736Google Scholar
  41. 41.
    Ouyang HB, Gao L, Kong XY, Zou DX, Li S (2015) Teaching-learning based optimization with global crossover for global optimization problems. Appl Math Comput 265:533–556MathSciNetzbMATHGoogle Scholar
  42. 42.
    Ghasemi M, Taghizadeh M, Ghavidel S, Aghaei J, Abbasian A (2015) Solving optimal reactive power dispatch problem using a novel teaching–learning-based optimization algorithm. Eng Appl Artif Intel 39:100–108Google Scholar
  43. 43.
    Zou F, Wang L, Hei X, Chen D, Yang D (2014) Teaching–learning-based optimization with dynamic group strategy for global optimization. Inform Sci 273:112–131Google Scholar
  44. 44.
    Lim WH, Isa NAM (2014) An adaptive two-layer particle swarm optimization with elitist learning strategy. Inform Sci 273:49–72MathSciNetGoogle Scholar
  45. 45.
    Zhan ZH, Zhang J, Li Y, Chung HSH (2009) Adaptive particle swarm optimization. IEEE Trans Syst Man Cybern Part B (Cybern) 39(6):1362–1381Google Scholar
  46. 46.
    Gandomi AH, Alavi AH (2011) Multi-stage genetic programming: a new strategy to nonlinear system modeling. Inform Sci 181(23):5227–5239Google Scholar
  47. 47.
    Gandomi AH, Yang XS, Alavi AH, Talatahari S (2013) Bat algorithm for constrained optimization tasks. Neural Comput Appl 22(6):1239–1255Google Scholar
  48. 48.
    Yang XS, Karamanoglu M, He X (2014) Flower pollination algorithm: a novel approach for multiobjective optimization. Eng Optim 46(9):1222–1237MathSciNetGoogle Scholar
  49. 49.
    MacQueen J (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, vol 1, pp 281–297Google Scholar
  50. 50.
    Maulik U, Bandyopadhyay S (2000) Genetic algorithm-based clustering technique. Pattern Recogn 33(9):1455–1465Google Scholar
  51. 51.
    Maulik U, Bandyopadhyay S (2000) Genetic algorithm-based clustering technique. Pattern Recogn 33(9):1455–1465Google Scholar
  52. 52.
    Shelokar PS, Jayaraman VK, Kulkarni BD (2004) An ant colony approach for clustering. Anal Chim Acta 509(2):187–195Google Scholar
  53. 53.
    Kao YT, Zahara E, Kao IW (2008) A hybridized approach to data clustering. Expert Syst Appl 34(3):1754–1762Google Scholar
  54. 54.
    Kumar Y, Sahoo G (2014) A hybrid data clustering approach based on cat swarm optimization and K-harmonic mean algorithm. J Inf Comput Sci 9(3):196–209Google Scholar
  55. 55.
    Kumar Y, Sahoo G (2015) A hybrid data clustering approach based on improved cat swarm optimization and K-harmonic mean algorithm. Ai Commun 28(4):751–764MathSciNetGoogle Scholar
  56. 56.
    Sahoo G (2017) A two-step artificial bee colony algorithm for clustering. Neural Comput Applic 28(3):537–551Google Scholar
  57. 57.
    Kumar Y, Sahoo G (2017) Gaussian cat swarm optimisation algorithm based on Monte Carlo method for data clustering. Int J Comput Sci Eng 14(2):198–210MathSciNetGoogle Scholar
  58. 58.
    Jordehi AR (2014) A chaotic-based big bang–big crunch algorithm for solving global optimisation problems. Neural Comput Applic 25(6):1329–1335Google Scholar
  59. 59.
    Jordehi AR (2015) A chaotic artificial immune system optimisation algorithm for solving global continuous optimisation problems. Neural Comput Applic 26(4):827–833Google Scholar
  60. 60.
    Jordehi AR (2015) Chaotic bat swarm optimisation (CBSO). Appl Soft Comput 26:523–530Google Scholar
  61. 61.
    Jordehi AR (2015) Seeker optimisation (human group optimisation) algorithm with chaos. J Exper Theor Artif Intell 27(6):753–762Google Scholar
  62. 62.
    Kumar Y, Sahoo G (2017) An improved cat swarm optimization algorithm based on opposition-based learning and cauchy operator for clustering. JIPS (J Inf Process Syst) 13(4):1000– 1013Google Scholar
  63. 63.
    Rai D (2017) Comments on “A note on multi-objective improved teaching-learning based optimization algorithm (MO-ITLBO)”. Int J Ind Eng Comput 8(2):179–190Google Scholar
  64. 64.
    Rao R (2016) Review of applications of TLBO algorithm and a tutorial for beginners to solve the unconstrained and constrained optimization problems. Decis Sci Lett 5(1):1–30MathSciNetGoogle Scholar
  65. 65.
    Tuo S, Yong L, Li Y, Lin Y, Lu Q (2017) HSTLBO: a hybrid algorithm based on harmony search and teaching-learning-based optimization for complex high-dimensional optimization problems. PloS one 12(4):e0175114Google Scholar
  66. 66.
    Yu K, Wang X, Wang Z (2016) An improved teaching-learning-based optimization algorithm for numerical and engineering optimization problems. J Intell Manuf 27(4):831–843Google Scholar
  67. 67.
    Khuat TT, Le MH (2017) A genetic algorithm with multi-parent crossover using quaternion representation for numerical function optimization. Appl Intell 46(4):810–826Google Scholar
  68. 68.
    Wang HB, Zhang KP, Tu XY (2015) A mnemonic shuffled frog leaping algorithm with cooperation and mutation. Appl Intell 43(1):32–48Google Scholar
  69. 69.
    Yi J, Gao L, Li X, Gao J (2016) An efficient modified harmony search algorithm with intersect mutation operator and cellular local search for continuous function optimization problems. Appl Intell 44(3):725–753Google Scholar
  70. 70.
    Guo W, Chen M, Wang L, Wu Q (2016) Backtracking biogeography-based optimization for numerical optimization and mechanical design problems. Appl Intell 44(4):894–903Google Scholar
  71. 71.
    Yi W, Gao L, Li X, Zhou Y (2015) A new differential evolution algorithm with a hybrid mutation operator and self-adapting control parameters for global optimization problems. Appl Intell 42(4):642–660Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringJUITWaknaghatIndia

Personalised recommendations