Skip to main content
SpringerLink
Log in

Evolving Connectionist Systems with Evolutionary Self-Optimisatio

  • Chapter
Do Smart Adaptive Systems Exist?

Part of the book series: Studies in Fuzziness and Soft Computing ((STUDFUZZ,volume 173))

  • 607 Accesses

9.8 Conclusions and Outlook

In this work, we summarised our current efforts on applying EC to build self-optimising ECOS. Two forms of EC, namely GA and ES, have been applied to on-line and off-line parameter optimisation and feature weighting of ECOS and have shown to be effective in enhancing ECOS’ performance. The proposed methods could lead to the development of fully autonomous, selforganised and self-optimised systems that learn in a life long learning mode from different sources of information and improve their performance over time regardless of the incoming data distribution and the changes in the data dynamics.

It must however, be emphasised that the listed applications of EC to ECOS are by no means exhaustive. There are still important areas in ECOS unexplored, e.g. clustering of data, aggregation of rule nodes and adjustment of node radii. Presently, new ECOS methods are being developed that are tailored to integrate with EC for optimising the control parameters as well as implementing feature selection/weighting simultaneously.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. T. Baeck, D. B. Fogel, and Z. Michalewicz. Evolutionary Computataion II. Advanced algorithm and operators, volume 2. Institute of Physics Pub., Bristol, 2000.

    Google Scholar 

  2. T. Baeck, D. B. Fogel, and Z. Michalewicz. Evolutionary Computation I. Basic algorithm and operators, volume 1. Institute of Physics Publishing, Bristol, 2000.

    Google Scholar 

  3. T. Baeck, U. Hammel, and H-P Schwefel. Evolutionary computation: Comments on the history and current state. IEEE Transactions on Evolutionary Computation, 1(1):3–17, Apr 1997.

    Article  Google Scholar 

  4. Thomas Baeck. Evolutionary algorithm in theory and practice: evolution strategies, evolutionary programming, genetic algorithms. Oxford University Press, New York, 1995.

    Google Scholar 

  5. H. G. Beyer. The Theory of Evolution Strategies. Natural Computing Series. Springer, Heidelberg, 2001.

    Google Scholar 

  6. C. Blake and C. Merc. Repository of machine learning databases, 1998.

    Google Scholar 

  7. Z. Chan and N. Kasabov. Evolutionary computation for on-line and off-line parameter tuning of evolving fuzzy neural networks. In International Conference on Neuro Information Processing (submitted), Vancouver, 2003.

    Google Scholar 

  8. Z. S. H. Chan, H. W. Ngan, A. B. Rad, and T. K. Ho. Alleviating “overfitting” via genetically-regularised neural network. Electronics Letter, 2002.

    Google Scholar 

  9. W. G. da Silva, P. P. Acarnley, and J. W. Finch. Application of genetic algorithms to the online tuning of electric drive speed controllers. IEEE Transactions on Industrial Electronics, 47(1):217–219, Feb 2000.

    Article  Google Scholar 

  10. D. B. Fogel. Evolving neural networks. Biol. Cybern., 63:487–493, 1990.

    Article  Google Scholar 

  11. D. B. Fogel. Using evolutionary programming to create neural networks that are capable of playing tic-tac-toe. In International Joint Conference on Neural Networks, pages 875–880, New York, 1993. IEEE Press.

    Google Scholar 

  12. D. E. Goldberg. Genetic Algorithms in Search, Optimization and machine Learning. Addison-Wesley, Reading, MA, 1989.

    Google Scholar 

  13. J. H. Holland. Adaptation in natural and artificial systems. The University of Michigan Press, Ann Arbor, MI, 1975.

    Google Scholar 

  14. I. Inza, P. Larranaga, and B. Sierra. Estimation of Distribution Algorithms. A new tool for Evolutionary Computation. Kluwer Academic Publishers, 2001.

    Google Scholar 

  15. I. Inza, P. Larranaga, and B. Sierra. Estimation of distribution algorithms for feature subset selection in large dimensionality domains. In H. Abbass, R. Sarker, and C. Newton, editors, Data Mining: A Heuristic Approach, pages 97–116. IDEA Group Publishing, 2001.

    Google Scholar 

  16. C. F. Juang. A tsk-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms. IEEE Transactions on Fuzzy Systems, 10(2):155–170, Apr 2002.

    Article  MathSciNet  Google Scholar 

  17. N. Kasabov. Evolving connectionist systems — methods and applications in bioinformatics, brain study and intelligent machines. Springer Verlag, London-New York, 2002.

    Google Scholar 

  18. N. Kasabov. Evolving fuzzy neural networks for on-line supervised/unsupervised, knowledge-based learning. IEEE Trans. SMC — part B, Cybernetics, 31(6):902–918, December 2001.

    Article  Google Scholar 

  19. N. Kasabov and D. Dimitrov. A method for gene regulatory network modelling with the use of evolving connectionist systems. In ICONIP’ 2002 — International Conference on Neuro-Information Processing, Singapore, 2002. IEEE Press.

    Google Scholar 

  20. N. Kasabov and Q. Song. Ga-parameter optimisation of evolving connectionist systems for classification and a case study from bioinformatics. In ICONIP’2002 — International Conference on Neuro-Information Processing, Singapore. IEEE Press, 2002.

    Google Scholar 

  21. N. Kasabov and Q. Song. Denfis: Dynamic, evolving neural-fuzzy inference systems and its application for time-series prediction. IEEE Trans. on Fuzzy Systems, 10(2):144–154, April 2002.

    Article  Google Scholar 

  22. N. Kasabov, Q. Song, and I. Nishikawa. Evolutionary computation for parameter optimisation of on-line evolving connectionist systems for prediction of time series with changing dynamics. In Int. Joint Conf. on Neural Networks IJCNN’2003, USA, 2003.

    Google Scholar 

  23. J. R. Koza. Genetic Programming. MIT Press, 1992.

    Google Scholar 

  24. D. A. Linkens and H. O. Nyongesa. Genetic algorithms for fuzzy control.2. online system development and application. IEE Proceedings of Control Theory and Applications, 142(3):177–185, May 1995.

    Article  MATH  Google Scholar 

  25. H. Liu and R. Setiono. Incremental feature selection. Applied Intelligence, 9(3):217–230, 1998.

    Article  Google Scholar 

  26. J. David C. MacKay. Bayesian methods for neural networks: Theory and applications. Technical Report Neural Networks Summer School lecture notes, Cavendish Laboratory, Cambridge, 2001.

    Google Scholar 

  27. S. Mishra, P. K. Dash, P. K. Hota, and M. Tripathy. Genetically optimized neuro-fuzzy ipfc for damping modal oscillations of power system. IEEE transactions on Power Systems, 17(4):1140–1147, Nov 2002.

    Article  Google Scholar 

  28. Radford M. Neal. Bayesian Learning for Neural Networks. Lecture Notes in Statistics. Springer-Verlag New York, Inc., 1996.

    Google Scholar 

  29. I. K. Nikolos, K. P. Valavanis, N. C. Tsourveloudis, and A. N. Kostaras. Evolutionary algorithm based offline/online path planner for uav navigation. Transactions on Systems, Man, and Cybernetics’ Part B: Cybernetics, page 1, 2003.

    Google Scholar 

  30. R. Palaniappan, P Raveendran, and S. Omatu. Vep optimal channel selection using genetic algoithm for neural network classification of alcoholics. IEEE Transactions on Neural Networks, 13(2):486–491, March 2002.

    Article  Google Scholar 

  31. S. Perkins, K. Lacker, and J. Theiler. Grafting: Fast, incremental feature selection by gradient descent in function space. Journal of Machine Learning Research, 3:1333–1356, 2003.

    Article  MATH  MathSciNet  Google Scholar 

  32. D. Quagliarella. Genetic algorithms and evolution strategy in engineering and computer science: recent advances and industrial applications. John Wiley and Sons, New York, 1998.

    Google Scholar 

  33. A. Rajapakse, K. Furuta, and S. Kondo. Evolutionary learning of fuzzy logic controllers and their adaptation through perpetual evolution. IEEE Transactions on Fuzzy Systems, 10(3):309–321, Jun 2002.

    Article  Google Scholar 

  34. Silicon Recognition. Zisc78 neural network silicon chip hardware reference manual. Technical report, May 20th 2003.

    Google Scholar 

  35. G. Rudolph. Convergence Properties of Evolutionary Algorithms. Kovac, Hambury, 1997.

    Google Scholar 

  36. H. P. Schwefel. Numerische Optimierung von Computer-Modellen mittels der Evolutionsstrategie, volume 26 of Interdisciplinary Systems Research. Birkhauser, Basel, Germany, 1977.

    Google Scholar 

  37. Q. Song and N. Kasabov. Weighted data normalization and feature selection for evolving connectionist sstems. In International Conference on Neuro Information Processing (submitted), 2003.

    Google Scholar 

  38. J. Tippayachai, W. Ongsakul, and I. Ngamroo. Parallel micro genetic algorithm for constrained economic dispathc. IEEE Transactions on Power Systems, 17(3):790–797, Aug 2002.

    Article  Google Scholar 

  39. Xin Yao and Yong Liu. A new evolutionary system for evolving artificial neural networks. IEEE Transactions on Neural Networks, 8(3):694–713, May 1997.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Private Bag 92006, Auckland, 1020, New Zealand

    N. Kasabov, Z. Chan, Q. Song & D. Greer

Authors
  1. N. Kasabov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Z. Chan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Q. Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. D. Greer
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Design, Engineering & Computing, Bournemouth University, Poole House, Talbot Campus, Fern Barrow, Poole, BH12 5BB, UK

    Bogdan Gabrys

  2. Department of Process Engineering, Control Engineering Laboratory, University Oulu, P.O.Box 4300, 90014, Oulu, Finland

    Kauko Leiviskä

  3. Institut für Mechanik, Lehrstuhl für Technische Dynamik, Universität Magdeburg, Universitätsplatz 2, 39106, Magdeburg, Germany

    Jens Strackeljan

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Kasabov, N., Chan, Z., Song, Q., Greer, D. (2005). Evolving Connectionist Systems with Evolutionary Self-Optimisatio. In: Gabrys, B., Leiviskä, K., Strackeljan, J. (eds) Do Smart Adaptive Systems Exist?. Studies in Fuzziness and Soft Computing, vol 173. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-32374-0_9

Download citation

  • DOI: https://doi.org/10.1007/3-540-32374-0_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-24077-8

  • Online ISBN: 978-3-540-32374-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation