Skip to main content

Evolutionary Approaches to Rule Extraction from Neural Networks

  • Chapter
Book cover Engineering Evolutionary Intelligent Systems

Part of the book series: Studies in Computational Intelligence ((SCI,volume 82))

Summary

A short survey of existing methods of rule extraction from neural networks starts the chapter. Because searching rules is similar to NP-hard problem it justifies an application of evolutionary algorithm to the rule extraction. The survey contains a short description of evolutionary based methods, as well. It creates a background to show own experiences from satisfying applications of evolutionary algorithms to this process. Two methods of rule extraction namely: REX and GEX are presented in details. They represent a global approach to rule extraction, perceiving a neural network by the set of pairs: input pattern and response produced by the neural network. REX uses prepositional fuzzy rules and is composed of two methods REX Michigan and REX Pitt. GEX takes an advantage of classical crisp rules. All details of these methods are described in the chapter. Their efficiency was tested in experimental studies using different benchmark data sets from UCI repository. The comparison to other existing methods was made and is presented in the chapter.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Hagan MT, Demuth HB, Beale M (1996) Neural network design. PWS, Boston, MA

    Google Scholar 

  2. McCulloch WS, Pitts W (1943) A logical calculus of the ideas imminent in nervous activity. Bull Math Biophys 5:115–133

    Article  MATH  MathSciNet  Google Scholar 

  3. Maier HR, Dandy HR (1997) Modeling cyanobacteria (blue-green algae) in the River Murray using artificial neural networks. Math Comput Simulation 43: 377–386

    Article  Google Scholar 

  4. Dibike YB, Minns AW, Abbott MB (1999) Applications of artificial neural networks to the generation of wave equations from hydraulic data. J Hydraulic Res 37(1):81–97

    Article  Google Scholar 

  5. Hurtado JE, Londono JE, Meza JE (2001) On the applicability of neural networks for soil dynamic amplification analysis. Soil Dyn Earthquake Eng 21(7):579–591

    Article  Google Scholar 

  6. Lee TL, Jeng DS (2002) Application of artificial neural networks in tide forecasting. Ocean Eng 29(9):1003–1022

    Article  Google Scholar 

  7. Mohamed AS, Holger RM, Mark BJ (2002) Predicting settlement of shallow foundations using neural networks. J Geotech Geo Envir Eng 128(9):785–793

    Google Scholar 

  8. Jeng DS, Lee TL, Lin C (2003) Application of artificial neural networks in assessment of Chi–Chi earthquake-induced liquefaction. Asian J Inf Technol 2(3):190–198

    Google Scholar 

  9. Leo SS, Lo HS (2004) Neural network based regression model of ground surface settlement induced by deep excavation automation in construction 13:279–289

    Google Scholar 

  10. Holland J (1975) Adaptation in natural and artificial systems. University of Michigan Press. (Second edition: MIT, Cambridge, MA, 1999)

    Google Scholar 

  11. Yao X (1993) Evolving artificial neural networks. Int J Neural Syst 4(3):203–222

    Article  Google Scholar 

  12. Gruau F, Whitley D, Pyeatt L (1996) A comparison between cellular encoding and direct encoding for genetic neural networks. In: Genetic programming 1996: proceedings of the first annual conference. MIT, Cambridge, MA, pp 81–89

    Google Scholar 

  13. Stanley KO, Miikkulainen R (2002) Evolving neural networks through augmenting topologies. Evol Comput 10(2):99–127

    Article  Google Scholar 

  14. Zen K, Umehara Y, Finn WDL (1985) A case study of the wave-induced liquefaction of sand layers under damaged breakwater. In: Proceedings of the third Canadian conference on marine geotechnical engineering, pp 505–520

    Google Scholar 

  15. Silvester R, Hsu JRC (1989) Sines Revisited. J Waterways, Port, Coastal Ocean Eng, ASCE 115(3):327–344

    Article  Google Scholar 

  16. Bjerrum J (1973) Geotechnical problem involved in foundations of structures in the North Sea. Geotechnique 23(3):319–358

    Article  Google Scholar 

  17. Nataraja MS, Singh H, Maloney D (1980) Ocean wave-induced liquefaction analysis: a simplified procedure. In: Proceedings of an international symposium on soils under cyclic and transient loadings, pp 509–516

    Google Scholar 

  18. Rahman MS (1997) Instability and movement of ocean floor sediments – a review. Int J Offshore Polar Eng 7(3):220–225

    Google Scholar 

  19. Jeng DS (1997) Wave-induced seabed instability in front of a breakwater. Ocean Eng 24(10):887–917

    Article  Google Scholar 

  20. Zen K, Yamazaki H (1991) Field observation and analysis of wave-induced liquefaction in seabed. Soils Found 31(4):161–179

    Google Scholar 

  21. Sassa S, Sekiguchi H (2001) Analysis of wave-induced liquefaction of sand beds. Geotechnique 51(2):115–126

    Article  Google Scholar 

  22. Sassa S, Sekiguchi H, Miyamamoto J (2001) Analysis of progressive liquefaction as moving-boundary problem. Geotechnique 51(10):847–857

    Article  Google Scholar 

  23. Jeng DS (2003) Wave-induced seafloor dynamics. Appl Mech Rev 56(4):407–429

    Article  Google Scholar 

  24. Jeng DS, Cha DH (2003) Effects of dynamic soil behaviour and wave non-linearity on the wave-induced pore pressure and effective stresses in porous seabed. Ocean Eng 30(16):2065–2089

    Article  Google Scholar 

  25. Montana DJ, Davis L (1989) Training Feedforward neural networks using genetic algorithms. In: Proceedings of the international joint conference on artificial intelligence, pp 762–767

    Google Scholar 

  26. Miller GF, Todd PM, Hegde PM (1989) Designing neural networks using genetic algorithms. In: Proceedings of the third international conference on genetic algorithms. Morgan Kaufmann, San Francisco

    Google Scholar 

  27. Cha DH (2003) Mechanism of ocean waves propagating over a porous seabed. MPhil Thesis, Griffith University, Australia

    Google Scholar 

  28. Biot MA (1956) Theory of propagation of elastic waves in a fluid-saturated porous solid. Part I: low frequency range; part II. High frequency analysis. J Acoustics Soc 28:168–191

    Article  MathSciNet  Google Scholar 

  29. Jeng DS, Cha DH, Michael B (2004) Neural network model for the prediction of wave-induced liquefaction potential. Ocean Eng 31(17–18):2073–2086

    Article  Google Scholar 

  30. Scott RF (1968) Principle of soil mechanics. Addison, MA

    Google Scholar 

  31. Michalewicz Z (1994) Genetic algorithms + data structures = evolution programs, AI Series, Springer, Berlin Heidelberg New York

    MATH  Google Scholar 

  32. Rooij van AJF, Jain LC, Johnson RP (1996) Neural network training using genetic algorithms. World Scientific, London

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Markowska-Kaczmar, U. (2008). Evolutionary Approaches to Rule Extraction from Neural Networks. In: Abraham, A., Grosan, C., Pedrycz, W. (eds) Engineering Evolutionary Intelligent Systems. Studies in Computational Intelligence, vol 82. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75396-4_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-75396-4_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-75395-7

  • Online ISBN: 978-3-540-75396-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics