Summary
Swarm Intelligence methods have been shown to produce good results in various problem domains. A well-known method belonging to this kind of algorithms is particle swarm optimization (PSO). In this chapter, we examine how adaptation mechanisms can be used in PSO algorithms to better deal with continuous optimization problems. In case of bound-constrained optimization problems, one has to cope with the situation that particles may leave the feasible search space. To deal with such situations, different bound handling methods were proposed in the literature, and it was observed that the success of PSO algorithms highly depends on the chosen bound handling method. We consider how velocity adaptation mechanisms can be used to cope with bounded search spaces. Using this approach we show that the bound handling method becomes less important for PSO algorithms and that using velocity adaptation leads to better results for a wide range of benchmark functions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aarts, E., Lenstra, J.K.: Local Search in Combinatorial Optimization. John Wiley & Sons, Chichester (2003)
Alvarez-Benitez, J.E., Everson, R.M., Fieldsend, J.E.: A MOPSO Algorithm Based Exclusively on Pareto Dominance Concepts. Evolutionlary Multi-Criterion Optimization, 459–473 (2005)
Bratton, D., Kennedy, J.: Defining a Standard for Particle Swarm Optimization. In: Proc. IEEE Swarm Intelligence Symp., pp. 120–127 (2007)
Clerc, M.: Tribes, a Parameter Free Particle Swarm Optimizer, http://clerc.maurice.free.fr/pso/ (last checked: 22.12.2008)(2003)
Clerc, M.: Confinements and Biases in Particle Swarm Optimization (2006), http://clerc.maurice.free.fr/pso/
Clerc, M.: Particle Swarm Optimization. ISTE Ltd. (2006)
Clerc, M., et al.: Standard PSO 2007 (2007), http://www.particleswarm.info (standard_pso_2007.c)
Cui, Z., Cai, X., Zeng, J.: Stochastic velocity threshold inspired by evolutionary programming. In: Proceedings of the 2009 World Congress on Nature & Biologically Inspired Computing, pp. 626–631 (2009)
Cui, Z., Zeng, J., Sun, G.: Adaptive velocity threshold particle swarm optimization. In: Rough Sets and Knowledge Technology. Springer, Heidelberg (2006)
Dorigo, M., Stützle, T.: Ant Colony Optimization. MIT Press, Cambridge (2004)
Eberhart, R.C., Shi, Y.: Comparing Inertia Weights and Constriction Factors in Particle Swarm Optimization. In: Proceedings of the 2000 Congress on Evolutionary Computation, pp. 84–88 (2000)
Eiben, A.E., Smith, J.E.: Introduction to Evolutionary Computing, 2nd edn. Springer, Heidelberg (2007)
Fan, H.: A modification to particle swarm optimization algorithm. Engineering Computations 19(8), 970–989 (2002)
Fourie, P.C., Groenwold, A.A.: The particle swarm optimization algorithm in size and shape optimization. Structural and Multidisciplinary Optimization 23(4), 259–267 (2002)
Goldberg, D.E.: Genetic Algorithms in Search Optimization and Machine Learning. Addison-Wesley, Reading (1989)
Helwig, S., Neumann, F., Wanka, R.: Particle swarm optimization with velocity adaptation. In: Proceedings of the International Conference on Adaptive and Intelligent Systems (ICAIS 2009), pp. 146–151. IEEE, Los Alamitos (2009)
Helwig, S., Wanka, R.: Particle Swarm Optimization in High-Dimensional Bounded Search Spaces. In: Proc. IEEE Swarm Intelligence Symp., pp. 198–205 (2007)
Helwig, S., Wanka, R.: Theoretical Analysis of Initial Particle Swarm Behavior. In: Rudolph, G., Jansen, T., Lucas, S., Poloni, C., Beume, N. (eds.) PPSN 2008. LNCS, vol. 5199, pp. 889–898. Springer, Heidelberg (2008)
Hoos, H.H., Stützle, T.: Stochastic Local Search: Foundations & Applications. Elsevier / Morgan Kaufmann (2004)
Janson, S., Middendorf, M.: A hierarchical particle swarm optimizer and its adaptive variant. IEEE Transactions on Systems, Man, and Cybernetics, Part B 35(6), 1272–1282 (2005)
Kennedy, J., Eberhart, R.C.: Particle Swarm Optimization. In: Proc. of the IEEE Int. Conf. on Neural Networks, vol. 4, pp. 1942–1948 (1995)
Kennedy, J., Eberhart, R.C.: Swarm Intelligence. Morgan Kaufmann, San Francisco (2001)
Kennedy, J., Mendes, R.: Population Structure and Particle Swarm Performance. In: Proceedings of the IEEE Congress on Evol. Computation, pp. 1671–1676 (2002)
Miranda, V., Fonseca, N.: EPSO – Best-of-two-worlds Meta-heuristic Applied to Power System Problems. In: Proceedings of the 2002 IEEE Congress on Evolutionary Computation, vol. 2, pp. 1080–1085. IEEE Press, Los Alamitos (2002)
Miranda, V., Fonseca, N.: New evolutionary particle swarm algorithm (EPSO) applied to Voltage/Var control. In: Proceedings of the 14th Power Systems Computation Conference (2002)
Price, K.V., Storn, R.M., Lampinen, J.A.: Differential Evolution: A Practical Approach to Global Optimization. Springer, Heidelberg (2005)
Pulido, G.T., Coello, C.A.C., Santana-Quintero, L.V.: EMOPSO: A Multi-Objective Particle Swarm Optimizer with Emphasis on Efficiency. In: Obayashi, S., Deb, K., Poloni, C., Hiroyasu, T., Murata, T. (eds.) EMO 2007. LNCS, vol. 4403, pp. 272–285. Springer, Heidelberg (2007)
Rechenberg, I.: Evolutionsstrategie – Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. Frommann-Holzboog, Verlag (1973)
Robinson, J., Rahmat-Samii, Y.: Particle Swarm Optimization in Electromagnetics. IEEE Trans. on Antennas and Propagation 52(2), 397–407 (2004)
Schwefel, H.-P.: Numerical optimization for computer models. John Wiley, Chichester (1981)
Schwefel, H.-P.P.: Evolution and Optimum Seeking: The Sixth Generation. John Wiley & Sons, Inc., New York (1993)
Suganthan, P.N., Hansen, N., Liang, J.J., Deb, K., Chen, Y., Auger, A., Tiwari, S.: Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization. KanGAL Report 2005005. Nanyang Technological University, Singapore (2005)
Takahama, T., Sakai, S.: Solving constrained optimization problems by the ε constrained particle swarm optimizer with adaptive velocity limit control. In: Proceedings of the 2006 IEEE International Conference on Cybernetics and Intelligent Systems, pp. 1–7 (2006)
Wilcoxon, F.: Individual Comparisons by Ranking Methods. Biometrics Bulletin 1(6), 80–83 (1945)
Zhang, W.-J., Xie, X.-F., Bi, D.-C.: Handling Boundary Constraints for Numerical Optimization by Particle Swarm Flying in Periodic Search Space. In: Proc. of the IEEE Congress on Evol. Computation, vol. 2, pp. 2307–2311 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Helwig, S., Neumann, F., Wanka, R. (2011). Velocity Adaptation in Particle Swarm Optimization. In: Panigrahi, B.K., Shi, Y., Lim, MH. (eds) Handbook of Swarm Intelligence. Adaptation, Learning, and Optimization, vol 8. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17390-5_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-17390-5_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17389-9
Online ISBN: 978-3-642-17390-5
eBook Packages: EngineeringEngineering (R0)