Abstract
The paper presents learning algorithms for a multidimensional adaptive growing neuro-fuzzy system with optimization of a neuron ensemble in every cascade. A building block for this architecture is a multidimensional neo-fuzzy neuron. The demonstrated system is distinguished from the well-recognized cascade systems in its ability to handle multidimensional data sequences in an online fashion, which makes it possible to treat non-stationary stochastic and chaotic data with the demanded accuracy. The most important privilege of the considered hybrid neuro-fuzzy system is its trait to accomplish a procedure of parallel computation for a data stream based on peculiar elements with upgraded approximating properties. The developed system turns out to be rather easy from the effectuation standpoint; it holds a high processing speed and approximating features. Compared to acclaimed countertypes, the developed system guarantees computational simpleness and owns both filtering and tracking aptitudes. The proposed system, which is ultimately a growing (evolving) system of computational intelligence, assures processing the incoming data in an online fashion just unlike the rest of conventional systems.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
da Silva, I.N., Spatti, D.H., Flauzino, R.A., Bartocci Liboni, L.H., dos Reis Alves, S.F.: Artificial Neural Networks: A Practical Course. Springer, Cham (2017)
Cartwright, H.: Artificial Neural Networks. Springer, New York (2015)
Suzuki, K.: Artificial Neural Networks: Architectures and Applications. InTech, New York (2013)
Koprinkova-Hristova, P., Mladenov, V., Kasabov, N.K.: Artificial Neural Networks: Methods and Applications in Bio-/Neuroinformatics. Springer, Cham (2015)
Borowik, G., Klempous, R., Nikodem, J., Jacak, W., Chaczko, Z.: Advanced Methods and Applications in Computational Intelligence. Springer, Cham (2014)
Graupe, D.: Principles of Artificial Neural Networks. Advanced Series in Circuits and Systems. World Scientific Publishing Co. Pte. Ltd., Singapore (2007)
Haykin, S.: Neural Networks and Learning Machines, 3rd edn. Prentice Hall, New Jersey (2009)
Hanrahan, G.: Artificial Neural Networks in Biological and Environmental Analysis. CRC Press, Boca Raton (2011)
Lughofer, E.: Evolving Fuzzy Systems and Methodologies: Advanced Concepts and Applications. Springer, Heidelberg (2011)
Angelov, P., Filev, D., Kasabov, N.: Evolving Intelligent Systems: Methodology and Applications. Willey, Hoboken (2010)
Kasabov, N.: Evolving Connectionist Systems. Springer, London (2003)
Fahlman, S., Lebiere, C.: The cascade-correlation learning architecture. Adv. Neural. Inf. Process. Syst. 2, 524–532 (1990)
Avedjan, E.D., Barkan, G.V., Levin, I.K.: Cascade neural networks. J. Avtomatika i Telemekhanika 3, 38–55 (1999)
Prechelt, L.: Investigation of the CasCor family of learning algorithms. Neural Netw. 10, 885–896 (1997)
Bodyanskiy, Y., Dolotov, A., Pliss, I., Viktorov, Y.: The cascaded orthogonal neural network. Int. J. Inf. Sci. Comput. 2, 13–20 (2008)
Bodyanskiy, Y., Viktorov, Y.: The cascaded neo-fuzzy architecture using cubic-spline activation functions. Int. J. Inf. Theor. Appl. 16(3), 245–259 (2009)
Bodyanskiy, Y., Viktorov, Y.: The cascaded neo-fuzzy architecture and its on-line learning algorithm. Int. J. Intel. Process. 9, 110–116 (2009)
Bodyanskiy, Y., Viktorov, Y., Pliss, I.: The cascade growing neural network using quadratic neurons and its learning algorithms for on-line information processing. Int. J. Intell. Inf. Eng. Syst. 13, 27–34 (2009)
Kolodyazhniy, V., Bodyanskiy, Y.: Cascaded multi-resolution spline-based fuzzy neural network. In: Angelov, P., Filev, D., Kasabov, N. (eds.) Proceedings of the International Symposium on Evolving Intelligent Systems, pp. 26–29. De Montfort University, Leicester (2010)
Bodyanskiy, Y., Kharchenko, O., Vynokurova, O.: Hybrid cascaded neural network based on wavelet-neuron. Int. J. Inf. Theor. Appl. 18(4), 335–343 (2011)
Bodyanskiy, Y., Grimm, P., Teslenko, N.: Evolving cascaded neural network based on multidimensional Epanechnikov’s kernels and its learning algorithm. Int. J. Inf. Technol. Knowl. 5(1), 25–30 (2011)
Bodyanskiy, Y., Vynokurova, O., Teslenko, N.: Cascaded GMDH-wavelet-neuro-fuzzy network. In: Proceedings of the 4th International Workshop on Inductive Modelling, Kyiv, pp. 22–30 (2011)
Bodyanskiy, Y., Vynokurova, O., Dolotov, A., Kharchenko, O.: Wavelet-neuro-fuzzy-network structure optimization using GMDH for the solving forecasting tasks. In: Proceedings of the International Workshop Inductive Modelling, Kyiv, pp. 61–67 (2013)
Bodyanskiy, Y., Tyshchenko, O., Kopaliani, D.: A hybrid cascade neural network with an optimized pool in each cascade. Soft. Comput. 19(12), 3445–3454 (2015)
Bodyanskiy, Y., Tyshchenko, O., Kopaliani, D.: An evolving connectionist system for data stream fuzzy clustering and its online learning. Neurocomputing (2017). http://www.sciencedirect.com/science/article/pii/S0925231217309785
Bodyanskiy, Y., Tyshchenko, O., Kopaliani, D.: Adaptive learning of an evolving cascade neo-fuzzy system in data stream mining tasks. Evolving Syst. 7(2), 107–116 (2016)
Bodyanskiy, Y., Tyshchenko, O., Deineko, A.: An evolving radial basis neural network with adaptive learning of its parameters and architecture. Autom. Control Comput. Sci. 49(5), 255–260 (2015)
Hu, Z., Bodyanskiy, Y.V., Tyshchenko, O.K., Boiko, O.O.: An evolving cascade system based on a set of neo-fuzzy nodes. Int. J. Intell. Syst. Appl. (IJISA) 8(9), 1–7 (2016)
Bodyanskiy, Y., Tyshchenko, O., Kopaliani, D.: A multidimensional cascade neuro-fuzzy system with neuron pool optimization in each cascade. Int. J. Inf. Technol. Comput. Sci. (IJITCS) 6(8), 11–17 (2014)
Miki, T., Yamakawa, T.: Analog implementation of neo-fuzzy neuron and its on-board learning. In: Mastorakis, N.E. (ed.) Computational Intelligence and Applications, pp. 144–149. WSES Press, Piraeus (1999)
Uchino, E., Yamakawa, T.: Soft computing based signal prediction, restoration and filtering. In: Ruan, D. (ed.) Intelligent Hybrid Systems: Fuzzy Logic, Neural Networks, and Genetic Algorithms, pp. 331–349. Kluwer Academic Publishers, Boston (1997)
Yamakawa, T., Uchino, E., Miki, T., Kusanagi, H.: A neo fuzzy neuron and its applications to system identification and prediction of the system behavior. In: Proceedings of the 2nd International Conference on Fuzzy Logic and Neural Networks, pp. 477–483 (1992)
Hoff, M., Widrow, B.: Adaptive switching circuits. In: Neurocomputing: Foundations of Research, pp. 123–134 (1988)
Kaczmarz, S.: Approximate solution of systems of linear equations. Int. J. Control 53, 1269–1271 (1993)
Ljung, L.: System Identification: Theory for the User. Prentice Hall, Upper Saddle River (1999)
Bodyanskiy, Y., Tyshchenko, O., Wojcik, W.: A multivariate non-stationary time series predictor based on an adaptive neuro-fuzzy approach. Elektronika - konstrukcje, technologie, zastosowania 8, 10–13 (2013)
Caminhas, W.M., Silva, S.R., Rodrigues, B., Landim, R.P.: A neo-fuzzy-neuron with real time training applied to flux observer for an induction motor. In: Proceedings 5th Brazilian Symposium on Neural Networks, pp. 67–72 (1998)
Bodyanskiy, Y.V., Pliss, I.P., Solovyova, T.V.: Multistep optimal predictors of multidimensional non-stationary stochastic processes. Doklady AN USSR A(12), 47–49 (1986)
Bodyanskiy, Y.V., Pliss, I.P., Solovyova, T.V.: Adaptive generalized forecasting of multidimensional stochastic sequences. Doklady AN USSR A(9), 73–75 (1989)
Bodyanskiy, Y., Pliss, I.: Adaptive generalized forecasting of multivariate stochastic signals. In: Proceedings of the International Conference on Latvian Signal Processing, vol. 2, pp. 80–83 (1990)
Acknowledgment
This research project is partially subvented by RAMECS and CCNU16A02015.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Hu, Z., Bodyanskiy, Y.V., Tyshchenko, O.K. (2018). A Multidimensional Adaptive Growing Neuro-Fuzzy System and Its Online Learning Procedure. In: Shakhovska, N., Stepashko, V. (eds) Advances in Intelligent Systems and Computing II. CSIT 2017. Advances in Intelligent Systems and Computing, vol 689. Springer, Cham. https://doi.org/10.1007/978-3-319-70581-1_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-70581-1_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-70580-4
Online ISBN: 978-3-319-70581-1
eBook Packages: EngineeringEngineering (R0)