Classification Rule Mining Algorithm Combining Intuitionistic Fuzzy Rough Sets and Genetic Algorithm

Abstract

This paper has proposed a classification rule base mining algorithm combining the genetic algorithm and intuitionistic fuzzy-rough set for large-scale intuitionistic fuzzy information system. The algorithm has proposed innovatively the definitions and measurement metrics of completeness, interaction and compatibility describing the whole rule base, and constructed a multi-objective optimization model to optimize the population size of data sample, and used the intuitionistic fuzzy-rough set to reduce the attribute set of fuzzy information system, and used intuitionistic fuzzy similar class to extract large-scale intuitionistic fuzzy information system rules, and obtained an optimal rule base with the minimal size, configuration, generation time and storage space. A threshold control mechanism is used to evaluate the completeness, interaction and correlation of rule population and improves the robustness and flexibility of sample population optimization and rule base generation. The algorithm is verified by the real aircraft health data sets. The algorithm is validated by similar mature and effective algorithms in accuracy, time complexity using real data and has good robustness and adaptability to different size large-scale fuzzy information system.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

References

  1. 1.

    Zhou, Z.J., Hu, C.H., Han, X.X., et al.: A model for online failure prognosis subject to two failure modes based on belief rule base and semi-quantitative information. Knowl. Based Syst. 70, 221–230 (2014)

    Google Scholar 

  2. 2.

    Yunxue, S.: An Algorithm of acquisition for diagnostic parameters of engine fault based on fuzzy-rough sets. In: Proceedings of 2007 IEEE International conference on Automation and Logistics, pp. 2306–2309, (2007)

  3. 3.

    Sanz, J.A., Bernardo, D., Herrera, F.: A compact evolutionary interval-valued fuzzy rule-based classification system for the modeling and prediction of real-world financial applications with imbalanced data. IEEE Trans. Fuzzy Syst. (2014). https://doi.org/10.1109/TFUZZ.2014.2336263

    Article  Google Scholar 

  4. 4.

    Sanz, J.A., Fernandez, A., Bustince, H., et al.: IVTURS: a linguistic fuzzy rule-based classification system based on a new interval-valued fuzzy reasoning method with tuning and rule selection. IEEE Trans. Fuzzy Syst. 21(3), 399–411 (2013)

    Google Scholar 

  5. 5.

    Alcala-Fdez, J., Alcala, R., Herrera, F.: A fuzzy association rule-based classification model for high-dimensional problems with genetic rule selection and lateral tuning. IEEE Trans. Fuzzy Syst. 19(5), 857–872 (2011)

    Google Scholar 

  6. 6.

    Cordón, O., Trawiński, K.: A novel framework to design fuzzy rule-based ensembles using diversity induction and evolutionary algorithms-based classifier selection and fusion, IWANN 2013, Part I, LNCS 7902. Springer, Berlin (2013)

    Google Scholar 

  7. 7.

    Si, X.S., Hu, C.H., Yang, J.B., et al.: A new prediction model based on belief rule base for system’s behavior prediction. IEEE Trans. Fuzzy Syst. 19(4), 636–650 (2011)

    Google Scholar 

  8. 8.

    Lin, J.C., Yang, L., Fournier-Viger, P., et al.: A binary PSO approach to mine high-utility itemsets. Soft Comput. (2017). https://doi.org/10.1007/s00500-016-2106-1.2016

    Article  Google Scholar 

  9. 9.

    Mansoori, E., Zolghadri, M., Katebi, S.: Sgerd: a steady-state genetic algorithm for extracting fuzzy classification rules from data. IEEE Trans. Fuzzy Syst. 16(4), 1061–1071 (2008)

    Google Scholar 

  10. 10.

    Hu, Y.-C., Chen, R.-S., Taeng, G.-H.: Finding fuzzy classification rules using data mining techniques. Pattern Recognit. Lett. 24(1-3), 509–519 (2003)

    MATH  Google Scholar 

  11. 11.

    Li, L.: Optimization of Apriori algorithm based on parallel MapReduce in cloud computing environment. Autom. Instrum. 177(7), 1–4 (2014)

    Google Scholar 

  12. 12.

    Qian, Y., Liang, X., Wang, Q., et al.: Local rough set: a solution to rough data analysis in big data. Int. J. Approx. Reason. 11, 1–30 (2017)

    Google Scholar 

  13. 13.

    Atanassov, K.: Intuitionistic fuzzy sets. Fuzzy Sets Syst. 20(1), 87–96 (1986)

    MATH  Google Scholar 

  14. 14.

    Chakrabarty, K., Gedeon, T., Koczy, L.: Intuitionistic fuzzy rough sets. In: Proc. 4th joint conf. on information sciences, Durham, NC:JCIS, pp. 211–214, (1998)

  15. 15.

    Wang, J., Zhao, H., Xu, J., et al.: Using IFS for anomaly detection of network traffic from flow interaction. IEEE Access 6(11), 64801–64816 (2018)

    Google Scholar 

  16. 16.

    Li, J.: Research on classification rule mining based on particle swarm optimization. Inf. Commun. 175(7), 21–22 (2017)

    Google Scholar 

  17. 17.

    Pan, W., Liu, Y., Tang, Y.: A novel algorithm based on particle swarm optimization to association rule mining. J. Anhui Univ. Technol. 31(3), 318–322 (2014)

    Google Scholar 

  18. 18.

    Tang, X.: Research on association rules mining based on ACO-MPSO algorithm. Xi’an University of Science and Technology, Xi’an (2016)

    Google Scholar 

  19. 19.

    Xiao, W., Hu, J., Zhou, X.: Parallel association rules mining algorithm based on MapReduce: a survey. Appl. Res. Comput. 35(1), 13–23 (2018)

    Google Scholar 

  20. 20.

    Ducange, P., Marcelloni, F., Segatori, A.: A MapReduce-based fuzzy associative classifier for big data. In: 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). https://doi.org/10.1109/fuzz-ieee.2015.7337868

  21. 21.

    Mao, W.: The Research of Parallel Association Rules Mining Algorithms Based on Cloud Platform. East China University of Technology, Shanghai (2014)

    Google Scholar 

  22. 22.

    Li, Q.: Research and Application of Association Rule Mining Algorithms Based on Parallel MapReduce. Beijing University of Posts and Telecommunications, Beijing (2018)

    Google Scholar 

  23. 23.

    Patel, M.R.: A parallel and distributed method to mine erasable itemsets from high utility patterns. Int. J. Adv. Res. Comput. Sci. Electron. Eng. 1(8), 99–104 (2012)

    Google Scholar 

  24. 24.

    Zhang, Y.: Association Rule Incremental Updating Algorithm and Its Application in Cloud. Beijing University of Chemical Technology, Beijing (2016)

    Google Scholar 

  25. 25.

    Ykhlef, M.: A quantum swarm evolutionary algorithm for mining association rules in large databases. J. King Saud Univ. Comput. Inf. Sci. 23, 1–6 (2011)

    Google Scholar 

  26. 26.

    Fernández, A., Carmona, C.J., del Jesus, M.J., Herrera, F.: A view on fuzzy systems for big data: progress and opportunities. Int. J. Comput. Intell. Syst. 9(Supplement 1), 69–80 (2016)

    Google Scholar 

  27. 27.

    Klemettinen, M., Mannila, H., Ronkainen, P., et al.: Finding interesting rules from large sets of discovered association rules. CiteSeer (1995). https://doi.org/10.1145/191246.191314

    Article  Google Scholar 

  28. 28.

    Fu, Y.: Discovery of Multiple-Level Rules from Large Databases. Simon Fraser University, Burnaby (1996)

    Google Scholar 

  29. 29.

    Song, Y.X., Zhang, C.C., Shi, Y.S.: Extracting algorithm for diagnostic parameters of aero-engine based on fuzzy-rough sets. J. Aerospace Power 23(6), 1127–1130 (2008)

    Google Scholar 

  30. 30.

    Bao, Z., Yang, S.: Knowledge reduction in intuitionistic fuzzy objective information systems. J. Univ. Sci. Technol. China 45(9), 776–783 (2015)

    MathSciNet  MATH  Google Scholar 

  31. 31.

    Luo, Q.J., Cheng, R.H., Na, J.: An algorithm for value reduction based on indiscernibility matrix (Natural Sciences Edition). J. Yunnan Univ. Natl. 20(6), 508–510 (2011)

    Google Scholar 

  32. 32.

    Ng, L., Chang, L., et al.: Rough set method for rule reduction in belief rule base. Control Decis. 29(11), 1943–1950 (2014)

    MATH  Google Scholar 

  33. 33.

    Zhang, Y., Wang, S., Ji, G.: A comprehensive survey on particle swarm optimization algorithm and its applications. Math. Probl. Eng. (2015). https://doi.org/10.1155/2015/931256

    MathSciNet  Article  MATH  Google Scholar 

  34. 34.

    Alcalá, R., Alcalá-Fdez, J., Gacto, M.J., et al.: Rule base reduction and genetic tuning of fuzzy systems based on the linguistic 3-tuples representation. Soft. Comput. 11(5), 401–419 (2007)

    MATH  Google Scholar 

  35. 35.

    Sanz, J., Fernández, A., Bustince, H., et al.: A genetic tuning to improve the performance of fuzzy rule-based classification systems with interval-valued fuzzy sets: degree of ignorance and lateral position. Int. J. Approx. Reason. 52(6), 751–766 (2011)

    Google Scholar 

  36. 36.

    Alcala-Fdez, J., Alcala, R., Herrera, F.: A fuzzy association rule-based classification model for high-dimensional problems with genetic rule selection and lateral tuning. IEEE Trans. Fuzzy Syst. (2011). https://doi.org/10.1109/tfuzz.2011.2147794

    Article  MATH  Google Scholar 

  37. 37.

    Yingjie, K.W.L.: Research on the completeness of the rulebase with intuitionistic fuzzy rough reasoning. Comput. Appl. Softw. 25(10), 93–94 (2008)

    Google Scholar 

  38. 38.

    Yingjie, K.W.L.: Research on interactivities of rules with intuitionistic fuzzy rough reasoning. Comput. Eng. Des. 29(10), 2626–2628 (2008)

    Google Scholar 

  39. 39.

    Alcalá, R., Alcalá-Fdez, J., Herrera, F.: A proposal for the genetic lateral tuning of linguistic fuzzy systems and its interaction with rule selection. IEEE Trans. Fuzzy Syst. 15(4), 616–635 (2007)

    MATH  Google Scholar 

  40. 40.

    Yingjie, K.W.L.: Research of rule-including with intuitionistic fuzzy rough reasoning. Comput. Appl. 27(9), 2279–2283 (2007)

    Google Scholar 

  41. 41.

    Gacto, M.J., Alcalá, R., Herrera, F.: Adaptation and application of multi-objective evolutionary algorithms for rule reduction and parameter tuning of fuzzy rule-based systems. Soft. Comput. 13(5), 419–436 (2009)

    Google Scholar 

  42. 42.

    Mahajan, S., Reshamwala, A.: An approach to optimize fuzzy time-interval sequential patterns using multi-objective genetic algorithm. Commun. Comput. Inf. Sci. 145, 115–120 (2011)

    Google Scholar 

  43. 43.

    Antonelli, M., Ducange, P., Lazzerini, B., et al.: Multi-objective evolutionary design of granular rule-based classifiers. Granul. Comput. 1, 37–58 (2016)

    Google Scholar 

  44. 44.

    Rajeswari, K.: Class association rule mining on a temporal database using fuzzy logic with genetic approach. Int. J. Eng. Res. Technol. 3(2), 612–616 (2014)

    Google Scholar 

  45. 45.

    Zhang, Y., Wang, S., Ji, G.: A rule-based model for bankruptcy prediction based on an improved genetic ant colony algorithm. Math. Probl. Eng. 2013, 1–10 (2013). https://doi.org/10.1155/2013/753251

    MathSciNet  Article  MATH  Google Scholar 

  46. 46.

    Zhang, J., Gao, Q., Huang, Z., et al.: Applying genetic algorithm in optimization of avionics fault diagnosis rules. Comput. Appl. Softw. 27(8), 148–151 (2010)

    Google Scholar 

  47. 47.

    Cabrita, C., Botzheim, J., Gedeon, T.D., et al.: Bacterial memetic algorithm for fuzzy rule base optimization. In: Automation Congress, pp. 1–6, (2007)

  48. 48.

    Chen, D.: Research on Threat Assessment Based on Intuitionistic Fuzzy Set Theory. Air Force Engineering University, Xi’an (2007)

    Google Scholar 

  49. 49.

    Lu, Y.L., Lei, Y.J., Hua, J.X.: Attribute reduction based on intuitionistic fuzzy rough set. Control Decis. 24(3), 336–341 (2009)

    MathSciNet  Google Scholar 

  50. 50.

    Bao, Z., Yang, S.: Positive domain reduction in intuitionistic fuzzy objective information systems. J. Univ. Sci. Technol. China 45(4), 329–336 (2015)

    MathSciNet  MATH  Google Scholar 

  51. 51.

    Lei, Y., Luo, Y., Kong, W.W., et al.: Intuitionistic Fuzzy-Rough Set Theory and Applications. Science Press, Beijing

  52. 52.

    Zhang, C.P.: Statistic Analysis Technique and Application. Chongqing University Press, Chongqing (1998)

    Google Scholar 

  53. 53.

    Liu, F.: Similarity measure and similarity direction between fuzzy rough sets. Comput. Eng. Appl. 41(35), 35–37 (2005)

    Google Scholar 

  54. 54.

    Lei, Y.J., Luo, Y.L., Kong, W.W., et al.: Intuitionistic Fuzzy-Rough Set Theory and Applications. Science Press, Beijing (2013)

    Google Scholar 

  55. 55.

    Cui, X.X.: Multi-objective Evolutionary Algorithms and Their Applications. National Defense Industry Press, Beijing (2006)

    Google Scholar 

Download references

Acknowledgements

This article was funded by the China Aviation Science Foundation (20150267001), and the author is very grateful. The author wishes to thank those researchers such as Lei Yingjie, Kong Weiwei, who had studied relevant theories and algorithms of completeness, interaction and compatibility for intuitionistic fuzzy rough classification rules.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Chuanchao Zhang.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Zhang, C. Classification Rule Mining Algorithm Combining Intuitionistic Fuzzy Rough Sets and Genetic Algorithm. Int. J. Fuzzy Syst. 22, 1694–1715 (2020). https://doi.org/10.1007/s40815-020-00849-2

Download citation

Keywords

  • Large-scale intuitionistic fuzzy information system
  • Intuitionistic fuzzy classification rule base
  • Completeness
  • Interaction
  • Compatibility
  • Multi-objective optimization
  • Genetic algorithm