Advertisement

A novel fuzzy rule extraction approach using Gaussian kernel-based granular computing

  • Guangyao Dai
  • Yi Hu
  • Yu Yang
  • Nanxun Zhang
  • Ajith Abraham
  • Hongbo Liu
Regular Paper
  • 13 Downloads

Abstract

In this paper, we present a novel fuzzy rule extraction approach by employing the Gaussian kernels and fuzzy concept lattices. First we introduce the Gaussian kernel to interval type-2 fuzzy rough sets to model fuzzy similarity relations and introduce a few concepts and theorems to improve the classification performance with fewer attributes accordingly. Based on this idea, we propose a novel attribute reduction algorithm, which can achieve better classification performance of deducing reduction subset of fewer attributes, and this will be used in the subsequent decision rule extraction. Then we justify the necessary and sufficient conditions of our fuzzy rule extraction approach through three implicit rule theorems and present a novel fuzzy decision rule extraction algorithm using fuzzy concept lattices and introduce the concepts of frequent nodes and candidate 2-tuples to our pruning strategy. Also, comparative performance experiments are carried out on the UCI datasets, and the results of both reduction subset size and classification ability show the advantages of our algorithm.

Keywords

Interval type-2 fuzzy rough sets Gaussian kernel Fuzzy formal concept Fuzzy similarity relation Granular computing 

Notes

Acknowledgements

The authors would like to thank Zongmei Wang and Chao Yang for their scientific collaboration in this research. This work is partly supported by the Program for New Century Excellent Talents in University (NCET-11-0861) and the National Natural Science Foundation of China (Grant Nos. 61472058, 61602086, 61702291 and 61772102).

Supplementary material

10115_2018_1318_MOESM1_ESM.zip (1.1 mb)
Supplementary material 1 (zip 1125 KB)

References

  1. 1.
    Ahmad SSS, Pedrycz W (2017) The development of granular rule-based systems: a study in structural model compression. Granul Comput 2(1):1–12Google Scholar
  2. 2.
    Antonelli M, Ducange P, Lazzerini B, Marcelloni F (2016) Multi-objective evolutionary design of granular rule-based classifiers. Granul Comput 1(1):37–58Google Scholar
  3. 3.
    Baixeries J, Sacarea C, Ojeda-Aciego M (2015) Formal concept analysis. Springer, BerlinzbMATHGoogle Scholar
  4. 4.
    Celik E, Gul M, Aydin N, Gumus AT, Guneri AF (2015) A comprehensive review of multi criteria decision making approaches based on interval type-2 fuzzy sets. Knowl Based Syst 85:329–341Google Scholar
  5. 5.
    Chen SM, Chang YC, Pan JS (2013) Fuzzy rules interpolation for sparse fuzzy rule-based systems based on interval type-2 Gaussian fuzzy sets and genetic algorithms. IEEE Trans Fuzzy Syst 21(3):412–425Google Scholar
  6. 6.
    Chen SM, Chien CY (2011) Parallelized genetic ant colony systems for solving the traveling salesman problem. Expert Syst Appl 38(4):3873–3883Google Scholar
  7. 7.
    Chen SM, Kao PY (2013) TAIEX forecasting based on fuzzy time series, particle swarm optimization techniques and support vector machines. Inf Sci 247(15):62–71MathSciNetGoogle Scholar
  8. 8.
    Chen SM, Lee LW (2010) Fuzzy multiple criteria hierarchical group decision-making based on interval type-2 fuzzy sets. IEEE Trans Syst Man Cybern Part A Syst Hum 40(5):1120–1128Google Scholar
  9. 9.
    Chen SM, Wang CY (2013) Fuzzy decision making systems based on interval type-2 fuzzy sets. Inf Sci 242(Supplement2):1–21MathSciNetzbMATHGoogle Scholar
  10. 10.
    Chen TY (2013) A signed-distance-based approach to importance assessment and multi-criteria group decision analysis based on interval type-2 fuzzy set. Knowl Inf Syst 35(1):193–231Google Scholar
  11. 11.
    Deng Z, Choi KS, Cao L, Wang S (2017) T2FELA: type-2 fuzzy extreme learning algorithm for fast training of interval type-2 TSK fuzzy logic system. IEEE Trans Neural Netw Learn Syst 25(4):664–676Google Scholar
  12. 12.
    Dubois D, Prade H (2016) Bridging gaps between several forms of granular computing. Granul Comput 1(2):115–126Google Scholar
  13. 13.
    Fkih F, Omri MN (2016) IRAFCA: an \({O}(n)\) information retrieval algorithm based on formal concept analysis. Knowl Inf Syst 48(2):465–491Google Scholar
  14. 14.
    Garibaldi JM, Guadarrama S (2011) Constrained type-2 fuzzy sets. In: Advances in type-2 fuzzy logic systems, pp 66–73Google Scholar
  15. 15.
    Gonzalez C, Castro JR, Melin P, Castillo O (2016) An edge detection method based on generalized type-2 fuzzy logic. Soft Comput 20(2):773–784Google Scholar
  16. 16.
    Hou J, Gao H, Xia Q, Qi N (2016) Feature combination and the kNN framework in object classification. IEEE Trans Neural Netw Learn Syst 27(6):1368–1378Google Scholar
  17. 17.
    Hu Q, Zhang L, Chen D, Pedrycz W, Yu D (2010) Gaussian kernel based fuzzy rough sets: model, uncertainty measures and applications. Int J Approx Reason 51(4):453–471zbMATHGoogle Scholar
  18. 18.
    Huang CC, Tseng TL, Jiang F, Fan YN, Hsu CH (2014) Rough set theory: a novel approach for extraction of robust decision rules based on incremental attributes. Ann Oper Res 216(1):163–189MathSciNetzbMATHGoogle Scholar
  19. 19.
    Janssen J, Laatz W (2017) Naive Bayes. Springer, BerlinGoogle Scholar
  20. 20.
    Kang X, Miao D (2016) A rough set model based on formal concept analysis in complex information systems. In: International conference on fuzzy systems and knowledge discovery, pp 206–214Google Scholar
  21. 21.
    Kaytoue M, Codocedo V, Buzmakov A, Baixeries J, Kuznetsov SO, Napoli A (2015) Pattern structures and concept lattices for data mining and knowledge processing. Springer, BerlinGoogle Scholar
  22. 22.
    Li H, Wu C, Wu L, Lam HK, Gao Y (2017) Filtering of interval type-2 fuzzy systems with intermittent measurements. IEEE Trans Cybern 46(3):668–678Google Scholar
  23. 23.
    Li J, Huang C, Mei C, Yin Y (2016) An intensive study on rule acquisition in formal decision contexts based on minimal closed label concept lattices. Intelligent automation and soft computing, pp 1–15Google Scholar
  24. 24.
    Lingras P, Haider F, Triff M (2016) Granular meta-clustering based on hierarchical, network, and temporal connections. Granul Comput 1(1):71–92Google Scholar
  25. 25.
    Liu H, Cocea M (2016) Granular computing-based approach for classification towards reduction of bias in ensemble learning. Granul Comput 2(3):131–139Google Scholar
  26. 26.
    Liu H, Cocea M (2017) Fuzzy information granulation towards interpretable sentiment analysis. Granul Comput 2(4):289–302Google Scholar
  27. 27.
    Liu H, Cocea M (2017) Semi-random partitioning of data into training and test sets in granular computing context. Granul Comput 2(4):357–387Google Scholar
  28. 28.
    Liu H, Gegov A, Cocea M (2016) Rule-based systems: a granular computing perspective. Granul Comput 1(4):259–274Google Scholar
  29. 29.
    Livi L, Sadeghian A (2016) Granular computing, computational intelligence, and the analysis of non-geometric input spaces. Granul Comput 1(1):13–20Google Scholar
  30. 30.
    Martinez-Ballesteros M, Troncoso A, Martinez-Alvarez F, Riquelme JC (2016) Improving a multi-objective evolutionary algorithm to discover quantitative association rules. Knowl Inf Syst 49(2):481–509Google Scholar
  31. 31.
    Mondal KC, Pasquier N, Maulik U, Maulik U, Bandhopadyay S (2016) A new approach for association rule mining and bi-clustering using formal concept analysis. In: International conference on machine learning and data mining in pattern recognition, pp 86–101Google Scholar
  32. 32.
    Parthal M, In N, Jensen R (2013) Unsupervised fuzzy-rough set-based dimensionality reduction. Inf Sci 229(6):106–121MathSciNetGoogle Scholar
  33. 33.
    Paul A (2016) Positive and negative association rule mining using correlation threshold and dual confidence approach. Springer India, New DelhiGoogle Scholar
  34. 34.
    Peters G, Weber R (2016) DCC: a framework for dynamic granular clustering. Granul Comput 1(1):1–11Google Scholar
  35. 35.
    Ren R, Wei L (2016) The attribute reductions of three-way concept lattices. Knowl Based Syst 99(C):92–102Google Scholar
  36. 36.
    Robniksikonja M, Kononenko I (2003) Theoretical and empirical analysis of relieff and rrelieff. Mach Learn 53(1):23–69zbMATHGoogle Scholar
  37. 37.
    Sahoo J, Das AK, Goswami A (2015) An effective association rule mining scheme using a new generic basis. Knowl Inf Syst 43(1):127–156Google Scholar
  38. 38.
    Sathyadevan S, Nair RR (2015) Comparative analysis of decision tree algorithms: id3, c4.5 and random forest. Springer India, New DelhiGoogle Scholar
  39. 39.
    Shawe-Taylor J, Cristianini N (2004) Kernel methods for pattern analysis. J Am Stat Assoc 101(476):1730–1730Google Scholar
  40. 40.
    Sheikhpour R, Sarram MA, Chahooki MAZ, Sheikhpour R (2017) A kernelized non-parametric classifier based on feature ranking in anisotropic Gaussian kernel. Neurocomputing 267:545–555Google Scholar
  41. 41.
    Singh PK, Kumar CA (2017) Concept lattice reduction using different subset of attributes as information granules. Granul Comput 2(3):159–173Google Scholar
  42. 42.
    Singh PK, Kumar CA, Li J (2016) Knowledge representation using interval-valued fuzzy formal concept lattice. Soft Comput 20(4):1485–1502zbMATHGoogle Scholar
  43. 43.
    Skowron A, Jankowski A, Dutta S (2016) Interactive granular computing. Granul Comput 1(2):95–113MathSciNetzbMATHGoogle Scholar
  44. 44.
    Smatana M, Butka P, Covekova L (2017) Tree based reduction of concept lattices based on conceptual indexes. Springer, BerlinGoogle Scholar
  45. 45.
    Sola HB, Fernandez J, Hagras H, Herrera F, Pagola M, Barrenechea E (2015) Interval type-2 fuzzy sets are generalization of interval-valued fuzzy sets: toward a wider view on their relationship. IEEE Trans Fuzzy Syst 23(5):1876–1882Google Scholar
  46. 46.
    Song M, Wang Y (2016) A study of granular computing in the agenda of growth of artificial neural networks. Granul Comput 1(4):247–257Google Scholar
  47. 47.
    Tahayori H, Antoni GD (2008) Operations on concavoconvex type-2 fuzzy sets. Int J Fuzzy Syst 10(4):276–286MathSciNetGoogle Scholar
  48. 48.
    Tripathy BK, Sooraj TR, Mohanty RK (2017) A new approach to interval-valued fuzzy soft sets and its application in decision-making. Springer, SingaporeGoogle Scholar
  49. 49.
    Tsai PW, Pan JS, Chen SM, Liao BY (2012) Enhanced parallel cat swarm optimization based on the Taguchi method. Expert Syst Appl 39(7):6309–6319Google Scholar
  50. 50.
    Vluymans S, Fernández A, Saeys Y, Cornelis C, Herrera F (2017) Dynamic affinity-based classification of multi-class imbalanced data with one-versus-one decomposition: a fuzzy rough set approach. Knowl Inf Syst 2017(1):1–30Google Scholar
  51. 51.
    Wang C, Qi Y, Shao M, Hu Q, Chen D, Qian Y, Lin Y (2017) A fitting model for feature selection with fuzzy rough sets. IEEE Trans Fuzzy Syst 25(4):741–753Google Scholar
  52. 52.
    Wang G (2017) DGCC: data-driven granular cognitive computing. Granul Comput 2(4):343–355Google Scholar
  53. 53.
    William-West TO, Singh D (2018) Information granulation for rough fuzzy hypergraphs. Granul Comput 3(1):75–92Google Scholar
  54. 54.
    Xie WX, Zhang QY, Sun ZM, Zhang F (2015) A clustering routing protocol for WSN based on type-2 fuzzy logic and ant colony optimization. Wirel Pers Commun 84(2):1165–1196Google Scholar
  55. 55.
    Xu W, Li W, Zhang X (2017) Generalized multigranulation rough sets and optimal granularity selection. Granul Comput 2(4):271–288Google Scholar
  56. 56.
    Xu WH, Zhang XY, Zhong JM, Zhang WX (2010) Attribute reduction in ordered information systems based on evidence theory. Knowl Inf Syst 25(1):169–184Google Scholar
  57. 57.
    Yang C, Liu H, McLoone S, Chen CLP, Wu X (2018) A novel variable precision reduction approach to comprehensive knowledge systems. IEEE Trans Cybern 48(2):661–674Google Scholar
  58. 58.
    Yang C, Liu H, Sun Y, Abraham A (2013) Multi-knowledge extraction from violent crime datasets using swarm rough algorithm. In: International conference on hybrid intelligent systems, pp 560–565Google Scholar
  59. 59.
    Yao Y (2016) Rough-set concept analysis: interpreting RS-definable concepts based on ideas from formal concept analysis. Inf Sci 346:442–462MathSciNetzbMATHGoogle Scholar
  60. 60.
    Yao Y (2016) A triarchic theory of granular computing. Granul Comput 1(2):145–157Google Scholar
  61. 61.
    Yu Q, Liu Z, Lin W, Shi B, Li Y (2005) Research on fuzzy concept lattice in knowledge discovery and a construction algorithm. Acta Electron Sin 33(2):350–353Google Scholar
  62. 62.
    Zadeh LA (1975) The concept of a linguistic variable and its application to approximate reasoning. Inf Sci 8(3):199–249MathSciNetzbMATHGoogle Scholar
  63. 63.
    Zhao T, Xiao J (2013) Interval type-2 fuzzy rough sets based on inclusion measures. Acta Autom Sin 39(10):1714–1721MathSciNetzbMATHGoogle Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2019

Authors and Affiliations

  1. 1.School of Information Science and TechnologyDalian Maritime UniversityDalianChina
  2. 2.Department of Mathematical SciencesGeorgia Southern UniversityStatesboroUSA
  3. 3.Machine Intelligence Research LabsScientific Network for Innovation and Research ExcellenceAuburnUSA

Personalised recommendations