Skip to main content

A Hybrid Cascade Neural Network with Ensembles of Extended Neo-Fuzzy Neurons and Its Deep Learning

  • Conference paper
  • First Online:
Information Technology, Systems Research, and Computational Physics (ITSRCP 2018)

Abstract

This research contribution instantiates a framework of a hybrid cascade neural network rest on the application of a specific sort of neo-fuzzy elements and a new peculiar adaptive training rule. The main trait of the offered system is its competence to continue intensifying its cascades until the required accuracy is gained. A distinctive rapid training procedure is also covered for this case that gives the possibility to operate with nonstationary data streams in an attempt to provide online training of multiple parametric variables. A new training criterion is examined which suits for handling nonstationary objects. Added to everything else, there is always an occasion to set up (increase) an inference order and a quantity of membership relations inside the extended neo-fuzzy neuron.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Haykin, S.: Neural Networks and Learning Machines. Prentice Hall, Upper Saddle River (2009)

    Google Scholar 

  2. Suzuki, K.: Artificial Neural Networks: Architectures and Applications. InTech, Hicksville (2013)

    Book  Google Scholar 

  3. Hanrahan, G.: Artificial Neural Networks in Biological and Environmental Analysis. CRC Press, Boca Raton (2011)

    Book  Google Scholar 

  4. Aggarwal, C.C.: A Data Mining: The Textbook. Springer, Cham (2015)

    Book  Google Scholar 

  5. Delen, D.: Real-World Data Mining: Applied Business Analytics and Decision Making. Pearson FT Press, Upper Saddle River (2015)

    Google Scholar 

  6. Larose, D.T.: Discovering Knowledge in Data: An Introduction to Data Mining. Wiley, Hoboken (2014)

    MATH  Google Scholar 

  7. Kruse, R., Borgelt, C., Klawonn, F., Moewes, C., Steinbrecher, M., Held, P.: Computational Intelligence. A Methodological Introduction. Springer, Berlin (2013)

    MATH  Google Scholar 

  8. Bodyanskiy, Ye, Tyshchenko, O., Deineko, A.: An Evolving Radial Basis Neural Network with Adaptive Learning of Its Parameters and Architecture. Autom. Control Comput. Sci. 49(5), 255–260 (2015)

    Article  Google Scholar 

  9. Mumford, C.L., Jain, L.C.: Computational Intelligence. Springer, Berlin (2009)

    Book  Google Scholar 

  10. Bifet, A., Gavaldà, R., Holmes, G., Pfahringer, B.: Machine Learning for Data Streams with Practical Examples in MOA. The MIT Press, Cambridge (2018)

    Google Scholar 

  11. Gama, J.: Knowledge Discovery from Data Streams. Chapman and Hall/CRC, Boca Raton (2010)

    Book  Google Scholar 

  12. Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge (2016)

    MATH  Google Scholar 

  13. Menshawy, A.: Deep Learning By Example: A Hands-On Guide to Implementing Advanced Machine Learning Algorithms and Neural Networks. Packt Publishing Limited, Birmhingham (2018)

    Google Scholar 

  14. Fahlman, S., Lebiere, C.: The cascade-correlation learning architecture. Adv. Neural. Inf. Process. Syst. 2, 524–532 (1990)

    Google Scholar 

  15. Yamakawa, T., Uchino, E., Miki, T., Kusanagi, H.: A neo fuzzy neuron and its applications to system identification and prediction of the system behavior. In: Proceedings of 2nd International Conference on Fuzzy Logic and Neural Networks, pp. 477–483 (1992)

    Google Scholar 

  16. Miki, T., Yamakawa, T.: Analog implementation of neo-fuzzy neuron and its on-board learning. In: Computational Intelligence and Applications, pp. 144–149. WSES Press, Piraeus (1999)

    Google Scholar 

  17. Uchino, E., Yamakawa, T.: Soft computing based signal prediction, restoration and filtering. In: Intelligent Hybrid Systems: Fuzzy Logic, Neural Networks and Genetic Algorithms, pp. 331–349. Kluwer Academic Publisher, Boston (1997)

    Chapter  Google Scholar 

  18. Bodyanskiy, Ye, Tyshchenko, O., Kopaliani, D.: A hybrid cascade neural network with an optimized pool in each cascade. Soft. Comput. 19(12), 3445–3454 (2015)

    Article  Google Scholar 

  19. Bodyanskiy, Ye., Tyshchenko, O.: A hybrid cascade neural network with ensembles of extended neo-fuzzy neurons and its deep learning. In: Kulczycki, P., Kowalski, P.A., Łukasik, S. (eds.) Contemporary Computational Science, p. 76. AGH-UST Press, Cracow (2018)

    Google Scholar 

  20. Bodyanskiy, Ye, Tyshchenko, O., Kopaliani, D.: An extended neo-fuzzy neuron and its adaptive learning algorithm. Int. J. Intell. Syst. Appl. (IJISA) 7(2), 21–26 (2015)

    Google Scholar 

  21. Jang, J.-S.R., Sun, C.T., Mizutani, E.: Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Prentice Hall, New Jersey (1997)

    Google Scholar 

  22. Takagi, T., Sugeno, M.: Fuzzy identification of systems and its application to modeling and control. IEEE Trans. Syst. Man Cybernet. 15, 116–132 (1985)

    Article  Google Scholar 

  23. Wang, L.X., Mendel, J.M.: Fuzzy basis functions, universal approximation and orthogonal least squares learning. IEEE Trans. Neural Netw. 3, 807–814 (1993)

    Article  Google Scholar 

  24. Wang, L.X.: Adaptive Fuzzy Systems and Control. Design and Stability Analysis. Prentice Hall, Upper Saddle River (1994)

    Google Scholar 

  25. Bodyanskiy, Ye, Tyshchenko, O., Kopaliani, D.: Adaptive learning of an evolving cascade neo-fuzzy system in data stream mining tasks. Evol. Syst. 7(2), 107–116 (2016)

    Article  Google Scholar 

  26. Hu, Zh., Bodyanskiy, Ye.V., Tyshchenko, O.K., Boiko, O.O.: An evolving cascade system based on a set of neo-fuzzy nodes. Int. J. Intell. Syst. Appl. (IJISA) 8(9), 1–7 (2016)

    Article  Google Scholar 

  27. Otto, P., Bodyanskiy, Ye, Kolodyazhniy, V.: A new learning algorithm for a forecasting neuro-fuzzy network. Integr. Comput. Aid. Eng. 10(4), 399–409 (2003)

    Article  Google Scholar 

  28. Bodyanskiy, Ye.V., Boryachok, M.D.: Optimal control of stochastic objects under conditions of uncertainty. ISDO, Kyiv (1993)

    Google Scholar 

Download references

Acknowledgment

Oleksii K. Tyshchenko is kindly grateful for the financial assistance of the Visegrad Scholarship Program—EaP #51700967 funded by the International Visegrad Fund (IVF).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Oleksii K. Tyshchenko .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bodyanskiy, Y.V., Tyshchenko, O.K. (2020). A Hybrid Cascade Neural Network with Ensembles of Extended Neo-Fuzzy Neurons and Its Deep Learning. In: Kulczycki, P., Kacprzyk, J., Kóczy, L., Mesiar, R., Wisniewski, R. (eds) Information Technology, Systems Research, and Computational Physics. ITSRCP 2018. Advances in Intelligent Systems and Computing, vol 945. Springer, Cham. https://doi.org/10.1007/978-3-030-18058-4_13

Download citation

Publish with us

Policies and ethics