Evolving Fuzzy Rules with UCS: Preliminary Results

  • Albert Orriols-Puig
  • Jorge Casillas
  • Ester Bernadó-Mansilla
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4998)


This paper presents Fuzzy-UCS, a Michigan-style Learning Fuzzy-Classifier System designed for supervised learning tasks. Fuzzy-UCS combines the generalization capabilities of UCS with the good interpretability of fuzzy rules to evolve highly accurate and understandable rule sets. Fuzzy-UCS is tested on a large collection of real-world problems, and compared to UCS and three highly-used machine learning techniques: the decision tree C4.5, the support vector machine SMO, and the fuzzy boosting algorithm Fuzzy LogitBoost. The results show that Fuzzy-UCS is highly competitive with respect to the four learners in terms of performance, and that the fuzzy representation permits a much better understandability of the evolved knowledge. These promising results of the online architecture of Fuzzy-UCS allow for further research and application of the system to new challenging problems.


Support Vector Machine Fuzzy Rule Machine Learning Technique Average Rank Linguistic Term 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aggarwal, C.: Data Streams: Models and Algorithms. Springer, Heidelberg (2007)CrossRefzbMATHGoogle Scholar
  2. 2.
    Alcalá-Fdez, J., del Jesus, M.J., Garrell, J.M., Herrera, F., Herbás, C., Sánchez, L.: Proyecto KEEL: Desarrollo de una herramienta para el análisis e implementación de algoritmos de extracción de conocimiento evolutivos. In: Aguilar, J.S., Giráldez, R., Riquelme, J.C. (eds.) Tendencias de la Minería de Datos en España, Red Española de Minería de Datos y Aprendizage, pp. 413–424 (2004)Google Scholar
  3. 3.
    Bernadó-Mansilla, E., Garrell, J.M.: Accuracy-Based Learning Classifier Systems: Models, Analysis and Applications to Classification Tasks. Evolutionary Computation 11(3), 209–238 (2003)CrossRefGoogle Scholar
  4. 4.
    Bernadó-Mansilla, E., Llorà, X., Garrell, J.M.: XCS and GALE: a comparative study of two learning classifier systems on data mining. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 2001. LNCS (LNAI), vol. 2321, pp. 115–132. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  5. 5.
    Blake, C.L., Merz, C.J.: UCI Repository of ML Databases: University of California (1998),
  6. 6.
    Bonarini, A.: Evolutionary Learning of Fuzzy rules: competition and cooperation. In: Pedrycz, W. (ed.) Fuzzy Modelling: Paradigms and Practice, pp. 265–284. Kluwer Academic Press, Norwell (1996)CrossRefGoogle Scholar
  7. 7.
    Bonarini, A., Trianni, V.: Learning fuzzy classifier systems for multi-agent coordination. Information Sciences: an International Journal 136(1-4), 215–239 (2001)CrossRefzbMATHGoogle Scholar
  8. 8.
    Bottou, L., Le Cun, Y.: On-line learning for very large data sets: Research Articles. Applied Stochastic Models in Business and Industry 21(2), 137–151 (2005)MathSciNetCrossRefzbMATHGoogle Scholar
  9. 9.
    Casillas, J., Carse, B., Bull, L.: Fuzzy-XCS: a michigan genetic fuzzy system. IEEE Transactions on Fuzzy Systems 15(4), 536–550 (2007)CrossRefGoogle Scholar
  10. 10.
    Cordón, O., del Jesús, M.J., Herrera, F.: Analyzing the Reasoning Mechanisms in Fuzzy Rule Based Classification Systems. Mathware & Soft Computing 5, 321–332 (1998)zbMATHGoogle Scholar
  11. 11.
    Cordón, O., Herrera, F., Hoffmann, F., Magdalena, L.: Genetic Fuzzy Systems: Evolutionary Tuning and Learning of Fuzzy Knowledge Bases. In: Advances in Fuzzy Systems—Applications and Theory, vol. 19, World Scientific, Singapore (2001)Google Scholar
  12. 12.
    Dems̃ar, J.: Statistical Comparisons of Classifiers over Multiple Data Sets. Journal of Machine Learning Research 7, 1–30 (2006)Google Scholar
  13. 13.
    Dunn, O.J.: Multiple Comparisons among Means. Journal of the American Statistical Association 56, 52–64 (1961)MathSciNetCrossRefzbMATHGoogle Scholar
  14. 14.
    Fisher, R.A.: Statistical Methods and Scientific Inference, 2nd edn. Hafner Publishing Co, New York (1959)Google Scholar
  15. 15.
    Friedman, M.: The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance. Journal of the American Statistical Association 32, 675–701 (1937)CrossRefzbMATHGoogle Scholar
  16. 16.
    Friedman, M.: A Comparison of Alternative Tests of Significance for the Problem of m Rankings. Annals of Mathematical Statistics 11, 86–92 (1940)MathSciNetCrossRefzbMATHGoogle Scholar
  17. 17.
    Furuhashi, T., Nakaoka, K., Uchikawa, Y.: Suppression of excess fuzziness using multiple fuzzy classifier systems. In: Proceedings of the 3th IEEE International Conference on Fuzzy Systems, pp. 411–414. Morgan Kaufmann, San Francisco (1994)Google Scholar
  18. 18.
    Goldberg, D.E.: Genetic Algorithms in Search, Optimization & Machine Learning, 1st edn. Addison Wesley, Reading (1989)zbMATHGoogle Scholar
  19. 19.
    Holland, J.H.: Adaptation in Natural and Artificial Systems. The University of Michigan Press (1975)Google Scholar
  20. 20.
    Ishibuchi, H., Nakashima, T., Murata, T.: Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems. IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics 29(5), 601–618 (1999)CrossRefGoogle Scholar
  21. 21.
    Orriols-Puig, A., Bernadó-Mansilla, E.: A Further Look at UCS Classifier System. In: GECCO 2006: Genetic and Evolutionary Computation Conference workshop program, Seattle, W.A., USA, 08–12 July 2006. ACM Press, New York (2006)Google Scholar
  22. 22.
    Otero, J., Sánchez, L.: Induction of descriptive fuzzy classifiers with the logitboost algorithm. Soft Computing 10(9), 825–835 (2006)CrossRefGoogle Scholar
  23. 23.
    Parodi, A., Bonelli, P.: A new approach to fuzzy classifier systems. In: Proceedings of the 5th International Conference on Genetic Algorithms, pp. 223–230. Morgan Kaufmann, San Francisco (1993)Google Scholar
  24. 24.
    Platt, J.: Fast Training of Support Vector Machines using Sequential Minimal Opt. In: Advances in Kernel Methods - Support Vector Lear. MIT Press, Cambridge (1998)Google Scholar
  25. 25.
    Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers, San Francisco (1995)Google Scholar
  26. 26.
    Sánchez, L., Couso, I.: Advocating the use of Imprecisely Observed Data in Genetic Fuzzy Systems. IEEE Transactions on Fuzzy Systems (2007) Google Scholar
  27. 27.
    Sánchez, L., Couso, I., Casillas, J.: Modeling vague data with genetic fuzzy systems under a combination of crisp and imprecise criteria. In: Proceedings of the 2007 IEEE Symposium on Computational Intelligence in Multicriteria Decision Making, pp. 346–353 (2007)Google Scholar
  28. 28.
    Sheskin, D.J.: Handbook of Parametric and Nonparametric Statistical Procedures. Chapman & Hall, Boca Raton (2000)zbMATHGoogle Scholar
  29. 29.
    Dietterich, T.G.: Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms. Neural Comp. 10(7), 1895–1924 (1998)CrossRefGoogle Scholar
  30. 30.
    Valenzuela-Radón, M.: The Fuzzy Classifier System: A Classifier System for Continuously Varying Variables. In: 4th ICGA, pp. 346–353. Morgan Kaufmann, San Francisco (1991)Google Scholar
  31. 31.
    Vapnik, V.: The Nature of Statistical Learning Theory. Springer, Heidelberg (1995)CrossRefzbMATHGoogle Scholar
  32. 32.
    Velasco, J.: Genetic-based on-line learning for fuzzy process control. International Journal of Intelligent Systems 13, 891–903 (1998)CrossRefGoogle Scholar
  33. 33.
    Wilcoxon, F.: Individual comparisons by ranking methods. Biometrics 1, 80–83 (1945)MathSciNetCrossRefGoogle Scholar
  34. 34.
    Wilson, S.W.: Get Real! XCS with Continuous-Valued Inputs. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 1999. LNCS (LNAI), vol. 1813, pp. 209–219. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  35. 35.
    Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques, 2nd edn. Morgan Kaufmann, San Francisco (2005)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Albert Orriols-Puig
    • 1
  • Jorge Casillas
    • 2
  • Ester Bernadó-Mansilla
    • 1
  1. 1.Grup de Recerca en Sistemes Intel·ligents Enginyeria i Arquitectura La SalleUniversitat Ramon LlullBarcelonaSpain
  2. 2.Dept. Computer Science and Artificial IntelligenceUniversity of GranadaGranadaSpain

Personalised recommendations