Advertisement

Neural Processing Letters

, Volume 34, Issue 1, pp 13–37 | Cite as

A Generalized Ellipsoidal Basis Function Based Online Self-constructing Fuzzy Neural Network

  • Ning Wang
Article

Abstract

In this paper, we propose a Generalized ellipsoidal basis function based online self-constructing fuzzy neural network (GEBF-OSFNN) which extends the ellipsoidal basis function (EBF)-based fuzzy neural networks (FNNs) by permitting input variables to be modeled by dissymmetrical Gaussian functions (DGFs). Due to the flexibility and dissymmetry of left and right widths of the DGF, the partitioning made by DGFs in the input space is more flexible and more interpretable, and therefore results in a parsimonious FNN with high performance under the online learning algorithm. The geometric growing criteria and the error reduction ratio (ERR) method are used as growing and pruning strategies respectively to realize the structure learning algorithm which implements an optimal and compact network structure. The GEBF-OSFNN starts with no hidden neurons and does not need to partition the input space a priori. In addition, all free parameters in premises and consequents are adjusted online based on the ε-completeness of fuzzy rules and the linear least square (LLS) approach, respectively. The performance of the GEBF-OSFNN paradigm is compared with other well-known algorithms like RAN, RANEKF, MRAN, ANFIS, OLS, RBF-AFS, DFNN, GDFNN GGAP-RBF, OS-ELM, SOFNN and FAOS-PFNN, etc., on various benchmark problems in the areas of function approximation, nonlinear dynamic system identification, chaotic time-series prediction and real-world benchmark problems. Simulation results demonstrate that the proposed GEBF-OSFNN approach can facilitate a more powerful and more parsimonious FNN with better performance of approximation and generalization.

Keywords

Generalized ellipsoidal basis function (GEBF) Fuzzy neural network (FNN) Online self-constructing Dissymmetrical Gaussian function (DGF) Fuzzy rule extraction 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Angelov P, Filev D (2004) An approach to on-line identification of evolving Takagi-Sugeno models. IEEE Trans Syst Man Cybern B Cynern 34: 484–498CrossRefGoogle Scholar
  2. 2.
    Chao CT, Chen YJ, Teng CC (1996) Simplification of fuzzy-neural systems using similarity analysis. IEEE Trans Syst Man Cybern B Cybern 26: 344–354CrossRefGoogle Scholar
  3. 3.
    Chen S, Cowan CFN, Grant PM (1991) Orthogonal least squares learning algorithm for radial basis function network. IEEE Trans Neural Netw 2: 1411–1423CrossRefGoogle Scholar
  4. 4.
    Cho KB, Wang BH (1996) Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction. Fuzzy Sets Syst 83: 325–339CrossRefMathSciNetGoogle Scholar
  5. 5.
    Er MJ, Wu S-Q (2002) A fast learning algorithm for parsimonious fuzzy neural systems. Fuzzy Sets Syst 126: 337–351MATHCrossRefMathSciNetGoogle Scholar
  6. 6.
    Gao Y, Er MJ (2003) Online adaptive fuzzy neural identification and control of a class of MIMO nonlinear systems. IEEE Trans Fuzzy Syst 11: 12–32Google Scholar
  7. 7.
    Gao Y, Er MJ (2005) NARMAX time series model prediction: feedforward and recurrent fuzzy neural network approaches. Fuzzy Sets Syst 150: 331–350MATHCrossRefMathSciNetGoogle Scholar
  8. 8.
    Gao Y, Er MJ (2005) An intelligent adaptive control scheme for postsurgical blood pressure regulation. IEEE Trans Neural Netw 16: 475–483CrossRefGoogle Scholar
  9. 9.
    Huang G-B, Saratchandran P, Sundararajan N (2004) An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks. IEEE Trans Syst Man Cybern B Cybern 34: 2284–2292CrossRefGoogle Scholar
  10. 10.
    Huang G-B, Saratchandran P, Sundararajan N (2005) A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation. IEEE Trans Neural Netw 16: 57–67CrossRefGoogle Scholar
  11. 11.
    Huang G-B, Zhu Q-Y, Siew C-K (2006) Extreme learning machine: theory and applications. Neurocomputing 70: 489–501CrossRefGoogle Scholar
  12. 12.
    Hsu C-F, Lin P-Z, Lee T-T, Wang C-H (2008) Adaptive asymmetric fuzzy neural network controller design via network structuring adaptation. Fuzzy Sets Syst 159: 2627–2649MATHCrossRefMathSciNetGoogle Scholar
  13. 13.
    Jang J-SR (1993) ANFIS: adaptive-network-based fuzzy inference system. IEEE Trans Syst Man Cybern 23: 665–684CrossRefGoogle Scholar
  14. 14.
    Jang J-SR, Sun CT, Mizutani E (1997) Neuro-fuzzy and soft computing. Prentice-Hall, Englewood Cliffs, NJGoogle Scholar
  15. 15.
    Juang C-F, Lin C-T (1998) An on-line self-constructing neural fuzzy inference network and its applications. IEEE Trans Fuzzy Syst 6: 12–32CrossRefGoogle Scholar
  16. 16.
    Kadirkamanathan V, Niranjan M (1993) A function estimation approach to sequential learning with neural networks. Neural Comput 5: 954–975CrossRefGoogle Scholar
  17. 17.
    Kasabov N, Song Q (2002) DENFIS: dynamic evolving neuralfuzzy inference system and its application for timeseries prediction. IEEE Trans Fuzzy Syst 10: 144–154CrossRefGoogle Scholar
  18. 18.
    Leng G, McGinnity TM, Prasad G (2005) An approach for online extraction of fuzzy rules using a selforganising fuzzy neural network. Fuzzy Sets Syst 150: 11–243CrossRefMathSciNetGoogle Scholar
  19. 19.
    Leng G, McGinnity TM, Prasad G (2006) Design for self-organizing fuzzy neural networks based on genetic algorithms. IEEE Trans Fuzzy Syst 14: 755–766CrossRefGoogle Scholar
  20. 20.
    Liang N-Y, Huang G-B, Saratchandran P, Sundararajan N (2006) A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17: 1411–1423CrossRefGoogle Scholar
  21. 21.
    Lin CT (1995) A neural fuzzy control system with structure and parameter learning. Fuzzy Sets Syst 70: 183–212CrossRefGoogle Scholar
  22. 22.
    Mitra S, Hayashi Y (2000) Neuro-fuzzy rule generation: survey in soft computing framework. IEEE Trans Neural Netw 11: 748–768CrossRefGoogle Scholar
  23. 23.
    Platt J (1991) A resource-allocating network for function interpolation. Neural Comput 3: 213–225CrossRefMathSciNetGoogle Scholar
  24. 24.
    Rojas I, Pomares H, Bernier JL et al (2002) Time series analysis using normalized PG-RBF network with regression weights. Neurocomputing 42: 267–285MATHCrossRefGoogle Scholar
  25. 25.
    Salmeron M, Ortega J, Puntonet CG, Prieto A (2001) Improved RAN sequential prediction using orthogonal techniques. Neurocomputing 41: 153–172MATHCrossRefGoogle Scholar
  26. 26.
    Sun ZL, Au KF, Choi TM (2007) A neuro-fuzzy inference system through integration of fuzzy logic and extreme learning machines. IEEE Trans Syst Man Cybern 37: 1321–1331CrossRefGoogle Scholar
  27. 27.
    Takagi T, Hayashi I (1991) NN-driven fuzzy reasoning. Int J Approx Reason 5: 191–212MATHCrossRefGoogle Scholar
  28. 28.
    Tzafestas SG, Zikidis KC (2001) NeuroFAST: online neuro-fuzzy ART-based structure and parameter learning TSK model. IEEE Trans Syst Man Cybern B Cybern 31: 797–802CrossRefGoogle Scholar
  29. 29.
    Velayutham CS, Kumar S (2005) Asymmetric subsethood-product fuzzy neural inference system (ASuPFuNIS). IEEE Trans Neural Netw 16: 160–174CrossRefGoogle Scholar
  30. 30.
    Wang LX (1994) Adaptive fuzzy systems and control: design and stability analysis. Prentice-Hall, Englewood Cliffs, NJGoogle Scholar
  31. 31.
    Wang N, Er MJ, Meng XY (2009) A fast and accurate online self-organizing scheme for parsimonious fuzzy neural networks. Neurocomputing 72: 3818–3829CrossRefGoogle Scholar
  32. 32.
    Wang N, Er MJ, Meng XY, Li X (2010) An online self-organizing scheme for parsimonious and accurate fuzzy neural networks. Int J Neural Syst 20: 389–405CrossRefGoogle Scholar
  33. 33.
    Wu S-Q, Er MJ (2000) Dynamic fuzzy neural networks—a novel approach to function approximation. IEEE Trans Syst Man Cybern B Cybern 30: 358–364CrossRefGoogle Scholar
  34. 34.
    Wu S-Q, Er MJ, Gao Y (2001) A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks. IEEE Trans Fuzzy Syst 9: 578–594CrossRefGoogle Scholar
  35. 35.
    Yingwei L, Sundararajan N, Saratchandran P (1997) A sequential learning scheme for function approximation using minimal radial basis function (RBF) neural networks. Neural Comput 9: 461–478MATHCrossRefGoogle Scholar
  36. 36.
    Yingwei L, Sundararajan N, Saratchandran P (1998) Performance evaluation of a sequential minimal radial basis function (RBF) neural network learning algorithm. IEEE Trans Neural Netw 9: 308–318CrossRefGoogle Scholar
  37. 37.
    Yu W, Li X (2004) Fuzzy identification using fuzzy neural networks with stable learning algorithms. IEEE Trans Fuzzy Syst 12: 411–420CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC. 2011

Authors and Affiliations

  1. 1.Marine Engineering CollegeDalian Maritime UniversityDalianChina

Personalised recommendations