Advertisement

A Study on Fuzzy Cognitive Map Optimization Using Metaheuristics

  • Aleksander CisłakEmail author
  • Władysław Homenda
  • Agnieszka Jastrzębska
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9842)

Abstract

Fuzzy Cognitive Maps (FCMs) are a framework based on weighted directed graphs which can be used for system modeling. The relationships between the concepts are stored in graph edges and they are expressed as real numbers from the \([-1,1]\) interval (called weights). Our goal was to evaluate the effectiveness of non-deterministic optimization algorithms which can calculate weight matrices (i.e. collections of all weights) of FCMs for synthetic and real-world time series data sets. The best results were reported for Differential Evolution (DE) with recombination based on 3 random individuals, as well as Particle Swarm Optimization (PSO) where each particle is guided by its neighbors and the best particle. The choice of the algorithm was not crucial for maps of size roughly up to 10 nodes, however, the difference in performance was substantial (in the orders of magnitude) for bigger matrices.

References

  1. 1.
    Bicup time series. http://robjhyndman.com/tsdldata/data/bicup2006.dat. Accessed 11 Jan 2016
  2. 2.
    Rainfall time series. http://robjhyndman.com/tsdldata/data/rainfall.dat. Accessed 11 Jan 2016
  3. 3.
    Bendtsen, C.: Package ‘PSO’. https://cran.r-project.org/web/packages/pso/pso.pdf. Accessed 1 Apr 2016
  4. 4.
    Byrd, R.H., Lu, P., Nocedal, J., Zhu, C.: A limited memory algorithm for bound constrained optimization. SIAM J. Sci. Comput. 16, 1190–1208 (1995)MathSciNetzbMATHCrossRefGoogle Scholar
  5. 5.
    Eberhart, R., Kennedy, J.: A new optimizer using particle swarm theory. In: Proceedings of the Sixth International Symposium on Micro Machine and Human Science, New York, NY, vol. 1, pp. 39–43. (1995)Google Scholar
  6. 6.
    Eiben, A.E., Hinterding, R., Michalewicz, Z.: Parameter control in evolutionary algorithms. IEEE Trans. Evol. Comput. 3(2), 124–141 (1999)CrossRefGoogle Scholar
  7. 7.
    Fortin, F.-A., De Rainville, F.-M., Gardner, M.-A., Parizeau, M., Gagné, C.: DEAP: evolutionary algorithms made easy. J. Mach. Learn. Res. 13, 2171–2175 (2012)MathSciNetzbMATHGoogle Scholar
  8. 8.
    Geem, Z.W., Kim, J., Loganathan, G.V.: A new heuristic optimization algorithm: harmony search. Simulation 76(2), 60–68 (2001)CrossRefGoogle Scholar
  9. 9.
    Homenda, W., Jastrzebska, A., Pedrycz, W.: Design of fuzzy cognitive maps for modeling time series. IEEE Trans. Fuzzy Syst. 24(1), 120–130 (2016)CrossRefGoogle Scholar
  10. 10.
    Karaboga, D., Basturk, B.: A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J. Global Optim. 39(3), 459–471 (2007)MathSciNetzbMATHCrossRefGoogle Scholar
  11. 11.
    Kosko, B.: Fuzzy cognitive maps. Int. J. Man-Mach. Stud. 24, 65–75 (1986)zbMATHCrossRefGoogle Scholar
  12. 12.
    Koulouriotis, D., Diakoulakis, I., Emiris, D.: Learning fuzzy cognitive maps using evolution strategies: a novel schema for modeling and simulating high-level behavior. In: Proceedings of IEEE Congress on Evolutionary Computation (CEC 2001), pp. 364–371 (2001)Google Scholar
  13. 13.
    León, M., Mkrtchyan, L., Depaire, B., Ruan, D., Bello, R., Vanhoof, K.: Learning method inspired on swarm intelligence for fuzzy cognitive maps: travel behaviour modelling. In: Villa, A.E.P., Duch, W., Érdi, P., Masulli, F., Palm, G. (eds.) ICANN 2012, Part I. LNCS, vol. 7552, pp. 718–725. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  14. 14.
    Mahdavi, M., Fesanghary, M., Damangir, E.: An improved harmony search algorithm for solving optimization problems. Appl. Math. Comput. 188(2), 1567–1579 (2007)MathSciNetzbMATHGoogle Scholar
  15. 15.
    Papageorgiou, E.: Learning algorithms for fuzzy cognitive maps - a review study. IEEE Trans. Syst. Man Cybern. Part C: Appl. Rev. 42(2), 150–163 (2012)CrossRefGoogle Scholar
  16. 16.
    Papageorgiou, E.: Maps, Fuzzy Cognitive Maps for Applied Sciences and Engineering: From Fundamentals to Extensions and Learning Algorithms. Springer Science & Business Media, Heidelberg (2013)Google Scholar
  17. 17.
    Papageorgiou, E., Parsopoulos, K., Stylios, C., Groumpos, P., Vrahatis, M.: Fuzzy cognitive maps learning using particle swarm optimization. J. Intell. Inf. Syst. 25(1), 95–121 (2005)CrossRefGoogle Scholar
  18. 18.
    Poli, R., Kennedy, J., Blackwell, T.: Particle swarm optimization. Swarm Intell. 1(1), 33–57 (2007)CrossRefGoogle Scholar
  19. 19.
    Stach, W., Kurgan, L., Pedrycz, W.: A survey of fuzzy cognitive map learning methods. Issues Soft Comput.: Theor. Appl., 71–84 (2005)Google Scholar
  20. 20.
    Stach, W., Kurgan, L., Pedrycz, W.: Numerical and linguistic prediction of time series. IEEE Trans. Fuzzy Syst. 16(1), 61–72 (2008)CrossRefGoogle Scholar
  21. 21.
    Stach, W., Kurgan, L., Pedrycz, W., Reformat, M.: Genetic learning of fuzzy cognitive maps. Fuzzy Sets Syst. 153, 371–401 (2005)MathSciNetzbMATHCrossRefGoogle Scholar
  22. 22.
    Storn, R., Price, K.: Differential evolution - a simple and efficient heuristic for global optimization over continuous spaces. J. Global Optim. 11(4), 341–359 (1997)MathSciNetzbMATHCrossRefGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2016

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 2.5 International License (http://creativecommons.org/licenses/by-nc/2.5/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

Authors and Affiliations

  • Aleksander Cisłak
    • 1
    Email author
  • Władysław Homenda
    • 2
  • Agnieszka Jastrzębska
    • 1
  1. 1.Faculty of Mathematics and Information ScienceWarsaw University of TechnologyWarsawPoland
  2. 2.Faculty of Economics and Informatics in VilniusUniversity of BialystokVilniusLithuania

Personalised recommendations