A Hybrid Cascade Neural Network with Ensembles of Extended Neo-Fuzzy Neurons and Its Deep Learning

  • Yevgeniy V. Bodyanskiy
  • Oleksii K. TyshchenkoEmail author
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 945)


This research contribution instantiates a framework of a hybrid cascade neural network rest on the application of a specific sort of neo-fuzzy elements and a new peculiar adaptive training rule. The main trait of the offered system is its competence to continue intensifying its cascades until the required accuracy is gained. A distinctive rapid training procedure is also covered for this case that gives the possibility to operate with nonstationary data streams in an attempt to provide online training of multiple parametric variables. A new training criterion is examined which suits for handling nonstationary objects. Added to everything else, there is always an occasion to set up (increase) an inference order and a quantity of membership relations inside the extended neo-fuzzy neuron.


Training procedure Data stream Computational intelligence Adaptive neuro-fuzzy system Extended neo-fuzzy neuron Membership function 



Oleksii K. Tyshchenko is kindly grateful for the financial assistance of the Visegrad Scholarship Program—EaP #51700967 funded by the International Visegrad Fund (IVF).


  1. 1.
    Haykin, S.: Neural Networks and Learning Machines. Prentice Hall, Upper Saddle River (2009)Google Scholar
  2. 2.
    Suzuki, K.: Artificial Neural Networks: Architectures and Applications. InTech, Hicksville (2013)CrossRefGoogle Scholar
  3. 3.
    Hanrahan, G.: Artificial Neural Networks in Biological and Environmental Analysis. CRC Press, Boca Raton (2011)CrossRefGoogle Scholar
  4. 4.
    Aggarwal, C.C.: A Data Mining: The Textbook. Springer, Cham (2015)CrossRefGoogle Scholar
  5. 5.
    Delen, D.: Real-World Data Mining: Applied Business Analytics and Decision Making. Pearson FT Press, Upper Saddle River (2015)Google Scholar
  6. 6.
    Larose, D.T.: Discovering Knowledge in Data: An Introduction to Data Mining. Wiley, Hoboken (2014)zbMATHGoogle Scholar
  7. 7.
    Kruse, R., Borgelt, C., Klawonn, F., Moewes, C., Steinbrecher, M., Held, P.: Computational Intelligence. A Methodological Introduction. Springer, Berlin (2013)zbMATHGoogle Scholar
  8. 8.
    Bodyanskiy, Ye, Tyshchenko, O., Deineko, A.: An Evolving Radial Basis Neural Network with Adaptive Learning of Its Parameters and Architecture. Autom. Control Comput. Sci. 49(5), 255–260 (2015)CrossRefGoogle Scholar
  9. 9.
    Mumford, C.L., Jain, L.C.: Computational Intelligence. Springer, Berlin (2009)CrossRefGoogle Scholar
  10. 10.
    Bifet, A., Gavaldà, R., Holmes, G., Pfahringer, B.: Machine Learning for Data Streams with Practical Examples in MOA. The MIT Press, Cambridge (2018)Google Scholar
  11. 11.
    Gama, J.: Knowledge Discovery from Data Streams. Chapman and Hall/CRC, Boca Raton (2010)CrossRefGoogle Scholar
  12. 12.
    Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge (2016)zbMATHGoogle Scholar
  13. 13.
    Menshawy, A.: Deep Learning By Example: A Hands-On Guide to Implementing Advanced Machine Learning Algorithms and Neural Networks. Packt Publishing Limited, Birmhingham (2018)Google Scholar
  14. 14.
    Fahlman, S., Lebiere, C.: The cascade-correlation learning architecture. Adv. Neural. Inf. Process. Syst. 2, 524–532 (1990)Google Scholar
  15. 15.
    Yamakawa, T., Uchino, E., Miki, T., Kusanagi, H.: A neo fuzzy neuron and its applications to system identification and prediction of the system behavior. In: Proceedings of 2nd International Conference on Fuzzy Logic and Neural Networks, pp. 477–483 (1992)Google Scholar
  16. 16.
    Miki, T., Yamakawa, T.: Analog implementation of neo-fuzzy neuron and its on-board learning. In: Computational Intelligence and Applications, pp. 144–149. WSES Press, Piraeus (1999)Google Scholar
  17. 17.
    Uchino, E., Yamakawa, T.: Soft computing based signal prediction, restoration and filtering. In: Intelligent Hybrid Systems: Fuzzy Logic, Neural Networks and Genetic Algorithms, pp. 331–349. Kluwer Academic Publisher, Boston (1997)CrossRefGoogle Scholar
  18. 18.
    Bodyanskiy, Ye, Tyshchenko, O., Kopaliani, D.: A hybrid cascade neural network with an optimized pool in each cascade. Soft. Comput. 19(12), 3445–3454 (2015)CrossRefGoogle Scholar
  19. 19.
    Bodyanskiy, Ye., Tyshchenko, O.: A hybrid cascade neural network with ensembles of extended neo-fuzzy neurons and its deep learning. In: Kulczycki, P., Kowalski, P.A., Łukasik, S. (eds.) Contemporary Computational Science, p. 76. AGH-UST Press, Cracow (2018)Google Scholar
  20. 20.
    Bodyanskiy, Ye, Tyshchenko, O., Kopaliani, D.: An extended neo-fuzzy neuron and its adaptive learning algorithm. Int. J. Intell. Syst. Appl. (IJISA) 7(2), 21–26 (2015)Google Scholar
  21. 21.
    Jang, J.-S.R., Sun, C.T., Mizutani, E.: Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Prentice Hall, New Jersey (1997)Google Scholar
  22. 22.
    Takagi, T., Sugeno, M.: Fuzzy identification of systems and its application to modeling and control. IEEE Trans. Syst. Man Cybernet. 15, 116–132 (1985)CrossRefGoogle Scholar
  23. 23.
    Wang, L.X., Mendel, J.M.: Fuzzy basis functions, universal approximation and orthogonal least squares learning. IEEE Trans. Neural Netw. 3, 807–814 (1993)CrossRefGoogle Scholar
  24. 24.
    Wang, L.X.: Adaptive Fuzzy Systems and Control. Design and Stability Analysis. Prentice Hall, Upper Saddle River (1994)Google Scholar
  25. 25.
    Bodyanskiy, Ye, Tyshchenko, O., Kopaliani, D.: Adaptive learning of an evolving cascade neo-fuzzy system in data stream mining tasks. Evol. Syst. 7(2), 107–116 (2016)CrossRefGoogle Scholar
  26. 26.
    Hu, Zh., Bodyanskiy, Ye.V., Tyshchenko, O.K., Boiko, O.O.: An evolving cascade system based on a set of neo-fuzzy nodes. Int. J. Intell. Syst. Appl. (IJISA) 8(9), 1–7 (2016)CrossRefGoogle Scholar
  27. 27.
    Otto, P., Bodyanskiy, Ye, Kolodyazhniy, V.: A new learning algorithm for a forecasting neuro-fuzzy network. Integr. Comput. Aid. Eng. 10(4), 399–409 (2003)CrossRefGoogle Scholar
  28. 28.
    Bodyanskiy, Ye.V., Boryachok, M.D.: Optimal control of stochastic objects under conditions of uncertainty. ISDO, Kyiv (1993)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Control Systems Research LaboratoryKharkiv National University of Radio ElectronicsKharkivUkraine
  2. 2.Institute for Research and Applications of Fuzzy Modeling, CE IT4InnovationsUniversity of OstravaOstravaCzech Republic

Personalised recommendations