Abstract
Although PSO has been successfully used in much application, the issues of trapping in local optimum and premature convergence can be avoided by using improved version of PSO (IPSO) by introducing new parameter called inertia weight. The IPSO is based on the global search properties of the traditional PSO and focuses on the suitable balance of the investigation and exploitation of the particles in the swarm for effective solution. During IPSO iterations, with increase in possible generations, the search space is decreased. Motivated from successful use of IPSO in many applications, in this paper, it is an attempt to design a MLP classifier with a hybrid back propagation learning based on IPSO. The proposed method has been tested using benchmark dataset from UCI machine learning repository and performances are compared with MLP, GA based MLP and PSO based MLP.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of the 1995 IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948 (1995)
Kennedy, J., Eberhart, R.: Swarm Intelligence Morgan Kaufmann, 3rd edn. Academic Press, New Delhi (2001)
Yang, E., Erdogan, A.T., Arslan, T., Barton, N.: An improved particle swarm optimization algorithm for power-efficient wireless sensor networks. In: 2007 ECSIS Symposium on Bio-inspired, Learning, and Intelligent Systems for Security. (2007). doi 10.1109/BLISS.2007.19
Zhixia, Z., Caiwu, L.: Application of the improved particle swarm optimizer to vehicle routing and scheduling problems. In: Proceedings of 2007 IEEE International Conference on Grey Systems and Intelligent Services, Nanjing, pp. 1150–1152, 18–20 Nov 2007
Wu, X., Qie, Z., Zhang, Z.Z.H.: Application of Improved PSO to optimization of gravity dam and sluice gate *. In: Proceedings of the 7th World Congress on Intelligent Control and Automation, Chongqing, pp. 6178–6182, 25–27 June 2008
Tang, X., Pang, Y., Chang, W., Li, Y.: Improved PSO-based S curve controller for motion control of underwater vehicle. In: Proceedings of the 7th World Congress on Intelligent Control and Automation, Chongqing, pp. 6949–6954, 25–27 June 2008
Chen, Q., Guo, W., Li, C.: An improved PSO algorithm to optimize BP neural network. In: 2009 5th International Conference on Natural Computation, pp. 351–360 (2009)
Park, J.-B., Jeong, Y.-W., Shin, J.-R., Lee, K.Y.: An improved particle swarm optimization for nonconvex economic dispatch problems. IEEE Trans. Power Syst. 25(1), 156–166 (2010)
Ran, M., Duan, H., Gao, X., Mao, Z. : Improved particle swarm optimization approach to path planning of amphibious mouse robot. In: 2011 6th IEEE Conference on Industrial Electronics and Applications, pp. 1146–1149 (2011). doi:978-1-4244-8756-1
Chew, K.S., Zarrabi, K.: Non-contact displacements measurement using an improved particle swarm optimization based digital speckle correlation method. In: 2011 International Conference on Pattern Analysis and Intelligent Robotics, Putrajaya, pp. 53–58, 28–29 June 2011
Ishaque, K., Salam, Z., Amjad, M., Mekhilef, S. : An improved particle swarm optimization (PSO)–based MPPT for PV with reduced steady-state oscillation. IEEE Trans. Power Electron. 27(8), 3627–3638 (2012)
Qais, M., AbdulWahid, Z.: A New Method for Improving Particle Swarm Optimization Algorithm (TriPSO). doi: 978-1-4673-5814-9
Geng, Q., Zhao, Z.: A Kind of Route Planning Method for UAV Based on Improved PSO Algorithm. doi: 978-1-4673-5534-6
Shakiba, R., Najafipour, M., Salehi, M.E.: An Improved PSO-Based Path Planning Algorithm For Humanoid Soccer Playing Robots. doi: 978-1-4673-6315-0
Yanqiu, L., Zheng, W., Dayu, Z., Yinghui, L., He, W.: Improved particle swarm optimization applied in calibrating a three-axis measuring system. In: Control Conference (CCC). 2013 32nd Chinese, pp. 3120–3123, IEEE (2013)
Qu, Z., Li, Q., Yue, L.: Improved particle swarm optimization for constrained optimization. In: 2013 International Conference on Information Technology and Applications, pp. 244–247 (2013)
Barani, M.J., Ayubi, P., Hadi, R.M.: Improved Particle Swarm Optimization Based on Chaotic Cellular Automata. doi: 978-1-4799-3351-8
Naik, B., Nayak, J., Behera, H.S.: A Novel FLANN with a hybrid PSO and GA based gradient descent learning for classification. In: Proceedings of the 3rd International Conference on Front of Intelligent Computing (FICTA). Advances in Intelligent Systems and Computing, vol. 1(327), pp. 745–754 (2014). doi: 10.1007/978-3-319-11933-5_84
Yue-bo, M.: ZouJian-hua, GanXu-sheng, ZhaoLiang: research on WNN aerodynamic modeling from flight data based on improved PSO algorithm. Neurocomputing 83, 212–221 (2012)
Yang, J.M., Kao, C.Y.: A robust evolutionary algorithm for training neural networks. Neural Comput. Appl. 10, 214–230 (2001)
Hamedi, M., et al.: Comparison of multilayer perceptron and radial basis function neural networks for EMG-based facial gesture recognition. In: The 8th International Conference on Robotic, Vision, Signal Processing and Power Applications, Springer, Singapore (2014)
Ndiaye, A., et al.: Development of a multilayer perceptron (MLP) based neural network controller for grid connected photovoltaic system. Int. J. Phys. Sci. 9(3), 41–47 (2014)
Roy, M., et al.: Ensemble of multilayer perceptrons for change detection in remotely sensed images. Geosci. Remote Sens. Lett. 49–53 IEEE 11.1, New York (2014)
Hassanien, A.E., et al.: MRI breast cancer diagnosis hybrid approach using adaptive ant-based segmentation and multilayer perceptron neural networks classifier. Appl. Softw Comput. 14, 62–71 (2014)
Aydin, K., Kisi, O.: Damage detection in Timoshenko beam structures by multilayer perceptron and radial basis function networks. Neural Comput. Appl. 24(3-4), 583–597 (2014)
Velo, R., López, P., Maseda, F.: Wind speed estimation using multilayer perceptron. Energy Convers. Manag. 81, 1–9 (2014)
Lee, S., Choeh, J.Y.: Predicting the helpfulness of online reviews using multilayer perceptron neural networks. Expert Syst. Appl. 41(6), 3041–3046 (2014)
Azim, S., Aggarwal, S.: Hybrid model for data imputation: using fuzzy c means and multi layer perceptron. In: IEEE Advance Computing Conference (IACC), pp. 1281–1285 (2014)
Chaudhuri, S., Goswami, S., Middey, A.: Medium-range forecast of cyclogenesis over North Indian Ocean with multilayer perceptron model using satellite data. Nat. Hazards 70(1), 173–193 (2014)
Bache, K., Lichman, M.: UCI Machine Learning Repository. [http://archive.ics.uci.edu/ml]. Irvine. CA: University of California, School of Information and Computer Science (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer India
About this paper
Cite this paper
Kanungo, D.P., Naik, B., Nayak, J., Baboo, S., Behera, H.S. (2015). An Improved PSO Based Back Propagation Learning-MLP (IPSO-BP-MLP) for Classification. In: Jain, L., Behera, H., Mandal, J., Mohapatra, D. (eds) Computational Intelligence in Data Mining - Volume 1. Smart Innovation, Systems and Technologies, vol 31. Springer, New Delhi. https://doi.org/10.1007/978-81-322-2205-7_32
Download citation
DOI: https://doi.org/10.1007/978-81-322-2205-7_32
Published:
Publisher Name: Springer, New Delhi
Print ISBN: 978-81-322-2204-0
Online ISBN: 978-81-322-2205-7
eBook Packages: EngineeringEngineering (R0)