Abstract
It has been demonstrated that learning the shape of sigmoidal function can improve performance of neuro-fuzzy controller. Backpropagation learning algorithm does not include the parameter of the sigmoidal function shape. This chapter proposes the use of genetic algorithm to learn the weights, biases and shape of the sigmoidal function of the neural network simultaneously. The performance of the system using a neural network with a linear activation function seems to be better than neural network with a non-linear activation function.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The term integrated is better suited here as the three technologies are in cooperative combination rather than hybrid as the term hybrid indicates some kind of amalgamated system in general.
References
Abraham A, Nath B. (2000) Evolutionary design of neuro-fuzzy systems: a generic framework. In: Proceedings of the 4th Japan—Australia joint workshop on intelligent and evolutionary systems, Japan, November 2000
Berenji HR, Khedkar P (1992) Learning and tuning fuzzy logic controllers through reinforcements. IEEE Trans Neural Netw 3:724–740
Buckley JJ, Hayashi Y (1994) Fuzzy neural networks: a survey. Fuzzy Sets Syst 66:1–13
Buckley JJ, Hayashi Y (1995) Neural networks for fuzzy systems. Fuzzy Sets Syst 71:265–276
Cantú-Paz E, Kamath C (2005) An empirical comparison of combinations of evolutionary algorithms and neural networks for classification problems. IEEE Trans Syst Man Cybern, Part B: Cybern 35(5):915–927
Castellano G, Castiello C, Fanelli AM, Jain L (2007) Evolutionary neuro-fuzzy systems and application, Chap. 2. In: Jain LC, Palade V, Srinivasa D (eds) Advances in evolutionary computing for systems design, Springer, Berlin
Chen C-H, Lin C-J, Lin C-T (2009) Nonlinear system control using adaptive neural fuzzy networks based on a modified differential evolution, IEEE Trans. Syst. Man Cybern. B Cybern.- Part C: Applications and Review, 39(4): 459–473
Chiaberge M, Bene G Di, Pascoli S. Di, Lazzerini B, Maggiore A, Reyneri LM (1995) Mixing fuzzy, neural and genetic algorithms in an integrated design environment for intelligent controllers. In: Proceedings of the IEEE international conference on systems, man and cybernetics, pp 2988–2993
Caudell TP, Dolan CP (1989) Parametric connectivity: training of constrained networks using genetic algorithms. In: Proceedings of the 3rd international conference on genetic algorithms (ICGA’89), George Mason University, June 4–7, pp 370–374
DasGupta B, Schniter G (1992) Efficient Approximation with neural Networks: A comparison of gate functions, technical report, Dept. Comput. Sci. Pennsylvania State University.
Farag WA, Quintana VH, Lambert-Torres G (1998) A genetic-based neuro-fuzzy approach for modeling and control of dynamical systems. IEEE Trans Neural Netw 9(5):756–767
Feng JC, Teng LC (1998) An online self constructing neural fuzzy inference network and its applications, IEEE Trans. Fuzzy Syst. 6(1):12–32
Figueiredo M, Gomide FAC (1999) Design of fuzzy systems using neurofuzzy networks. IEEE Trans. Neural Networks 10(4):815-827
Fukuda T, Shimojima K, Shibata T (1994) Fuzzy, neural networks and genetic algorithm based control systems. In: Proceedings of the IEEE international conference on industrial electronics, control and instrumentation, pp 1220–1225
Gao W (2003) Study on new evolutionary neural network. In: Proceedings of the second international conference on machine learning and cybernetics, Wan, 2–5 November 2003, pp 1287–1292
Haykin S (1999) Neural Networks - A Comprehensive Foundation, Prentice Hall, Upper Saddle River, NJ
Jang J-SR (1993) ANFIS: adaptive-network-based fuzzy inference system. IEEE Trans Syst Man Cybern 23(3):665–685
Jang JSR, Sun CT, Mizutani E (1997) Neuro-fuzzy and Soft Computing. Prentice Hall, Upper Saddle River
Kazabov N (1996) Foundations of neural networks, fuzzy systems and knowledge engineering. MIT Press, Cambridge, MA
Kasabov N, Song Q (1999) Dynamic evolving fuzzy neural networks with ‘m-out-of-n’ activation nodes for on-line adaptive systems, Technical Report TR99/04, Department of Information Science, University of Otago
Kosko B (1991) Neural networks and fuzzy systems. Prentice-Hall, Upper Saddle River
Lin TC, Lee CS (1991) Neural network based fuzzy logic control and decision system. IEEE Trans Comput 40(12):1320–1336
Lin CT, Lee CSG (1996) Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems. Prentice-Hall, Upper Saddle River
Lin C-J, Chen C-H, Lin C-T (2008) Efficient self-evolving evolutionary learning for neuro-fuzzy inference systems. IEEE Trans Fuzzy Syst 16(6):1476–1490
Lin CT, Han MF, Lin YY, Liao SH, Chang JY (2011) Neuro-fuzzy system design using differential evolution with local information. In: 2011 IEEE International conference on fuzzy systems, June 27–30, Taipei, Taiwan, pp 1003–1006
Liu Y, Yao X (1996) Evolutionary design of artificial neural networks with different nodes. In: Proceedings of the 1996 IEEE international conference on evolutionary computation (ICEC’96), Nagoya, Japan, pp. 670–675
Loila V, Sessa S, Staiano A, Tagliaferri R (2000) Merging fuzzy logic, neural networks and genetic computation in the design of a decision support system. Int J Intell Syst 15:575–594
Montana DJ, Davis L (1989). Training feedforward neural network using genetic algorithms. In: Proceedings of 11th international joint conference on artificial intelligence, San Mateo, CA, Morgan Kaufmann, pp 762–767
Nauck D, Klawonn F, Kruse R (1997) Foundations of neuro-fuzzy systems. Wiley, Chichester, NY, Weinheim, Brisbane, Singapore, Toronto
Nie J, Linkens D (1995) Fuzzy-neural control: principles, algorithms and applications. Prentice-Hall International (UK) Ltd, Upper Saddle River
Rahmoun A, Berrani S (2001) A Genetic-based Neuro-Fuzzy Generator: NEF-GEN, ACS/IEEE Int. Conf. on Comput. Syst. and Appl. pp 18–23
Russo F (1999) Evolutionary neural fuzzy systems for noise cancellation in image data. IEEE Trans Instrum Measurement 48(5):915–920
Schaffer JD, Whitley D, Eshelman LJ (1992) Combinations of genetic algorithms and neural networks: a survey of the state of art. IEEE International workshop on combinations of genetic algorithms and neural networks, Baltimore, pp 1–37
Seng TL, Khalid MB, Yusof R (1999) Tuning of a Neuro-Fuzzy Controller by Genetic Algorithm, IEEE Trans. Syst. Man Cybern. B Cybern.- Part B: Cybernetics, 29(2):226–236.
Shin YC, Xu C (2009) Intelligent systems: modelling, optimisation and control. CRC Press, Taylor and Francis Group, Boca Raton, Fl
Siddique NH, Tokhi MO (2001) Training neural networks: backpropagation vs genetic algorithms. In: IEEE international joint conference on neural network, Washington DC, 14–19 July, pp 2673–2678
Siddique N, Adeli H (2013) Computational Intelligence: Synergies of fuzzy logic, neural networks and evolutionary computing, John Wiley and Sons
Sulzberger SM, Tschicholg-Gurman NN, Vestli SJ (1993) FUN: Optimization of fuzzy rule based systems using neural networks, In: Proceedings of the IEEE Conference on Neural Networks, San Francisco, pp 312–316
Stork DG, Walker S, Burns M, Jackson B (1990) Pre-adaptation in neural circuits. In: Proceedings of the international joint conference on neural networks, vol I. Washington DC, pp 002–205
Tano S, Oyama T, Arnould T (1996) Deep combination of fuzzy inference and neural network in fuzzy Inference, Fuzzy Sets Syst. 82(2):151–160
Tong DL, Mintram R (2010) Genetic algorithm- neural network (GANN): a study of neural network activation functions and depth of genetic algorithm search to feature selection. Int J Mach Learning Cybern 1:75–87
Tsoukalas LH, Uhrig RE (1997) Fuzzy and neural approaches in engineering. Wiley, Hoboken
Wang WY, Li YH (2003) Evolutionary learning of BMF fuzzy-neural networks using a reduced-form genetic algorithm. IEEE Trans Syst Man Cybern Part B Cybern 33(2003):966–976
Whiteley D, Starkweather T, Bogart C (1990) Genetic algorithms and neural networks: optimizing connections and connectivity. Parallel Comput 14:347–361
Yamada T, Yabuta T (1992) Neural network controller using auto tuning method for nonlinear functions. IEEE Trans Neural Netw 3(4):595–601
Yam JYF, Chow TWS (1997) Extended least squares based algorithm for training feedforward networks. IEEE Trans Neural Netw 8(3):806–810
Yao X, Liu Y (1997) A new evolutionary system for evolving artificial neural networks. IEEE Trans Neural Netw 8(3):694–713
Yao X, Liu Y (1998) Making use of population information in evolutionary artificial neural networks. IEEE Trans Syst Man Cybern Part B: Cybern 28(3):417–425
Yao X (1999) Evolving artificial neural networks. Proc IEEE 87(9):1423–1447
Yu L, Zhang Y-Q (2005) Evolutionary fuzzy neural networks for hybrid financial prediction. IEEE Trans Syst Man Cybern -Part C: Appl Rev 35(2):244–249
Zadeh LA (1973) Outline of a new approach to analysis of complex systems and decision process. IEEE Trans Syst Man Cybern SMC-3:28–44
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Siddique, N. (2014). Evolutionary-Neuro-Fuzzy Control. In: Intelligent Control. Studies in Computational Intelligence, vol 517. Springer, Cham. https://doi.org/10.1007/978-3-319-02135-5_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-02135-5_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-02134-8
Online ISBN: 978-3-319-02135-5
eBook Packages: EngineeringEngineering (R0)