Skip to main content

On the Usefulness of MOEAs for Getting Compact FRBSs Under Parameter Tuning and Rule Selection

  • Chapter
Multi-Objective Evolutionary Algorithms for Knowledge Discovery from Databases

Part of the book series: Studies in Computational Intelligence ((SCI,volume 98))

In the last years, multi-objective genetic algorithms have been successfully applied to obtain Fuzzy Rule-Based Systems satisfying different objectives, usually different performance measures.

Recently, multi-objective genetic algorithms have been also applied to improve the difficult trade-off between interpretability and accuracy of Fuzzy Rule-Based Systems, obtaining linguistic models not only accurate but also interpretable. It is know that both requirements are usually contradictory, however, a multi-objective genetic algorithm can obtain a set of solutions with different degrees of accuracy and interpretability.

This contribution briefly reviews the state of the art in this very recent topic and presents an approach in order to prove the ability of multi-objective genetic algorithms for getting compact fuzzy rule-based systems under rule selection and parameter tuning, i.e., to obtain linguistic models with improved accuracy and the least number of possible rules. This way to work involves another trade-off degree respect with the works in the existing literature which has been still not explored.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Casillas J, CordĂłn O, Herrera F, Magdalena L (2003) (eds), Interpretability issues in fuzzy modeling. Studies in Fuzziness and Soft Computing 129, Springer, Heidelberg, Germany

    Google Scholar 

  2. Casillas J, Cordón O, del Jesus M J, Herrera F (2005) Genetic tuning of fuzzy rule deep structures preserving interpretability and its interaction with fuzzy rule set reduction. IEEE Transactions on Fuzzy Systems 13(1):13–29

    Article  Google Scholar 

  3. Coello Coello C A, Toscano G (2001) A micro-genetic algorithm for multiobjective optimization. First International Conference on Evolutionary Multi-Criterion Optimization, Lecture Notes in Computer Science 1993:126–140

    Google Scholar 

  4. Coello Coello C A, Toscano G (2001) Multiobjective optimization using a micro-genetic algorithm. Proceedings of the Genetic and Evolutionary Computation Conference (San Francisco, California), 274–282

    Google Scholar 

  5. Coello Coello C A, Van Veldhuizen D A, Lamont G B (2002) Evolutionary algorithms for solving multi-objective problems. Kluwer Academic Publishers

    Google Scholar 

  6. Coello Coello C A (2006) Evolutionary multiobjective optimization: A historical view of the field. IEEE Computational Intelligence Magazine 1(1):28–36

    Article  MathSciNet  Google Scholar 

  7. Cordón O, Herrera F, Sánchez L (1999), Solving electrical distribution problems using hybrid evolutionary data analysis techniques. Applied Intelligence 10:5–24

    Article  Google Scholar 

  8. Cordon O, Herrera F, del Jesus M J, Villar P (2001) A multiobjective genetic algorithm for feature selection and granularity learning in fuzzy-rule based classification systems. Proceedings of IX IFSA World Congress and XX NAFIPS International Conference, Vancouver, Canada, 1253–1258

    Google Scholar 

  9. Corne D, Knowles J, Oates M (2000) The pareto envelope-based selection algorithm for multiobjective optimization. Proceedings of the Parallel Problem Solving from Nature VI Conference, Lecture Notes in Computer Science 1917:839–848

    Google Scholar 

  10. Corne D, Jerram N, Knowles J, Oates M (2001) PESA-II: Region based selection in evolutionary multiobjective optimization. Proceedings of the Genetic and Evolutionary Computation Conference, San Francisco, Califormia, 283–290

    Google Scholar 

  11. Deb K, Agrawal S, Pratab A, Meyarivan T (2000) A fast elitist non-dominated sorting genetic algorithm for multi-objective optimization: NSGA-II. Proceedings of the Parallel Problem Solving from Nature VI Conference, Lecture Notes in Computer Science 1917, Paris, France, 849–858

    Google Scholar 

  12. Deb K (2001) Multi-objective optimization using evolutionary algorithms, John Wiley & Sons, Chichester, UK

    MATH  Google Scholar 

  13. Deb K, Agrawal S, Pratab A, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6(2):182-197

    Article  Google Scholar 

  14. Erickson M, Mayer A, Horn J (2001) The niched Pareto genetic algorithm 2 applied to the design of groundwater remediation systems. Proceedings of the First International Conference on Evolutionary Multi-Criterion Optimization, Lecture Notes in Computer Science 1993, London, UK, 681–695

    Google Scholar 

  15. Eshelman L J (1991) The CHC adaptive search algorithm: How to have safe search when engaging in nontraditional genetic recombination. Foundations of genetic Algorithms 1:265–283

    Google Scholar 

  16. Eshelman L J, Schaffer J D (1993) Real-coded genetic algorithms and interval-schemata. Foundations of Genetic Algorithms 2:187–202

    Google Scholar 

  17. Fonseca C M, Fleming P J (1993) Genetic algorithms for multiobjective optimization: Formulation, discussion and generalization. Proceedings of the Fifth International Conference on Genetic Algorithms, San Mateo, California, 416–423

    Google Scholar 

  18. Horn J, Nafpliotis N, Goldberg D E (1994) A niched pareto genetic algorithm for multiobjective optimization. Proceedings of the First IEEE Conference on Evolutionary Computation, IEEE World Congress on Computational Intelligence 1:82–87

    Article  Google Scholar 

  19. Ishibuchi H, Murata T, Turksen I B (1995) Selecting linguistic classification rules by two-objective genetic algorithms. Proceedings of IEEE-SMC’95, Vancouver, Canada, 1410–1415

    Google Scholar 

  20. Ishibuchi H, Murata T (1996) Multi-objective genetic local search algorithm. Proceedings of Third IEEE International Conference Evolutionary Computation, Japan, 119-124

    Google Scholar 

  21. Ishibuchi H, Murata T, Turksen I B (1997) Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems. Fuzzy Sets and Systems 89(2):135–150

    Article  Google Scholar 

  22. Ishibuchi H, Murata T, Gen M (1998) Performance evaluation of fuzzy rule-based classification systems obtained by multi-objective genetic algorithms. Computers & Industrial Engineering 35(3–4):575–578

    Article  Google Scholar 

  23. Ishibuchi H, Nakashima T, Murata T (2001) Three-objective genetics-based machine learning for linguistic rule extraction. Information Sciences 136:109–133

    Article  MATH  Google Scholar 

  24. Ishibuchi H, Nakashima T, Murata T (2001) Multiobjective optimization in linguistic rule extraction from numerical data. Proceedings of the First International Conference on Evolutionary Multi-Criterion Optimization, Lecture Notes in Computer Science 1993:588–602

    Google Scholar 

  25. Ishibuchi H, Yamamoto T (2003) Interpretability issues in fuzzy genetics-based machine learning for linguistic modelling. In Lawry J, Shanahan J G, Ralescu A L (eds) Modelling with Words: Learning, Fusion, and Reasoning within a Formal Liguistic Representation Framework, Lecture Notes in Computer Science 2873, Springer-Verlag, Berlin, Heidelberg, 209–228

    Google Scholar 

  26. Ishibuchi H, Nakashima T, Nii M (2004) (eds) Classification and modeling with linguistic information granules. Advanced Approaches to Linguistic Data Mining Series: Advanced Information Processing, Springer, Berlin

    Google Scholar 

  27. Ishibuchi H, Yamamoto T (2004) Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining. Fuzzy Sets and Systems 141(1):59–88

    Article  MATH  MathSciNet  Google Scholar 

  28. Ishibuchi H, Nojima Y (2007) Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning. International Journal of Approximate Reasoning 44(1):4–31

    Article  MATH  MathSciNet  Google Scholar 

  29. Jimenez F, Gomez-Skarmeta A F, Roubos H, Babuska R (2001) Accurate, transparent, and compact fuzzy models for function approximation and dynamic modeling through multi-objective evolutionary optimization. Proceedings of First International Conference on Evolutionary Multi-Criterion Optimization, Lecture Notes in Computer Science, 1993:653–667

    Google Scholar 

  30. Jimenez F, Gomez-Skarmeta A F, Roubos H, Babuska R (2001) A multi-objective evolutionary algorithm for fuzzy modelling. Proceedings of 9th IFSA World Congress and 20th NAFIPS International Conference, Vancouver, Canada, 1222–1228

    Google Scholar 

  31. Knowles J D, Corne D W (2000) Approximating the non dominated front using the Pareto archived evolution strategy. Evolutionary Computation 8(2):149–172

    Article  Google Scholar 

  32. Narukawa K, Nojima Y, Ishibuchi H (2005) Modification of evolutionary multiobjectiveoptimization algorithms for multiobjective design of fuzzy rule-based classification systems. Proceedings of 2005 IEEE International Conference on Fuzzy Systems, 809–814

    Google Scholar 

  33. Mamdani E H, Assilian S (1975) An experiment in linguistic synthesis with a fuzzy logic controller. International Journal of Man-Machine Studies 7:1–13

    Article  MATH  Google Scholar 

  34. Rudolph G, Agapie A (2000) Convergence properties of some multi-objective evolutionary algorithms. Proceedings of the 2000 Conference on Evolutionary Computation, 1010–1016

    Google Scholar 

  35. Srinivas N, Deb K (1994) Multiobjective optimization using nondominated sorting in genetic algorithms. Evolutionary Computation 2:221-248

    Article  Google Scholar 

  36. Takagi T, Sugeno M (1985) Fuzzy identification of systems and its application to modeling and control. IEEE Transactions on Systems, Man, and Cybernetics 15(1):116–132

    MATH  Google Scholar 

  37. Wang L X, Mendel J M (1992) Generating fuzzy rules by learning from examples. IEEE Transactions on Systems, Man, and Cybernetics 22(6):1414–1427

    Article  MathSciNet  Google Scholar 

  38. Wang H L, Kwong S, Jin Y C, Wei W, Man K F (2005) Multi-objective hierarchical genetic algorithm for interpretable fuzzy rule-based knowledge extraction. Fuzzy Sets and Systems 149(1):149–186

    Article  MATH  MathSciNet  Google Scholar 

  39. Wang H L, Kwong S, Jin Y C, Wei W, Man K F (2005) Agentbased evolutionary approach for interpretable rule-based knowledge extraction. IEEE Trans. on Systems, Man, and Cybernetics - Part C: Applications and Reviews 35(2):143–155

    Article  Google Scholar 

  40. Zitzler E, Thiele L (1998) Multiobjective optimization using evolutionary algorithms–a comparative study. In Eiben A (eds) Parallel Problem Solving from Nature V, Springer-Verlag, Amsterdam, 292–301

    Chapter  Google Scholar 

  41. Zitzler E, Thiele L (1999) Multiobjective evolutionary algorithms: A comparative case study and the strength Pareto approach. IEEE Transactions on Evolutionary Computation 3(4):257–271

    Article  Google Scholar 

  42. Zitzler E, Deb K, Thiele L (2000) Comparison of multiobjective evolutionary algorithms: Empirical results. Evolutionary Computation 8(2):173–195

    Article  Google Scholar 

  43. Zitzler E, Laumanns M, Thiele L (2001) SPEA2: Improving the strength Pareto evolutionary algorithm for multiobjective optimization. Proceedings of the Evolutionary Methods for Design, Optimization and Control with Application to Industrial Problems, Barcelona, Spain, 95-100

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Alcalá, R., Alcalá-Fdez, J., Gacto, M.J., Herrera, F. (2008). On the Usefulness of MOEAs for Getting Compact FRBSs Under Parameter Tuning and Rule Selection. In: Ghosh, A., Dehuri, S., Ghosh, S. (eds) Multi-Objective Evolutionary Algorithms for Knowledge Discovery from Databases. Studies in Computational Intelligence, vol 98. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77467-9_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-77467-9_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-77466-2

  • Online ISBN: 978-3-540-77467-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics