Abstract
In this chapter, we introduce three design strategies of classifiers which exploit the unified usage of the AFS fuzzy logic, entropy measures and decision trees. The advantage of these classifiers is two-fold. First, they can mimic the human reasoning and in this manner offer a far more transparent and comprehensible way supporting the design of the classifiers. An important aspect is concerned with the simplicity of the design methodology and the clarity of the underlying semantics. We use three well known data to illustrate the effectiveness of the classifiers and present the relationship between the parameters of the classifiers and their performance.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Ait Kbir, M., Benkirane, H., Maalmi, K., Benslimane, R.: Hierarchical fuzzy partition for pattern classification with fuzzy if-then rules. Pattern Recognition Letters 21, 503–509 (2000)
Abonyi, J., Roubos, J.A., Szeifert, F.: Data-driven generation of compact accurate and linguistically sound fuzzy classifiers based on a decision-tree initialization. International Journal of Approximate Reasoning 32, 1–21 (2003)
Antonie, M.L., Zaiane, O.R., Holte, R.C.: Learning to Use a Learned Model: A Two-Stage Approach to Classification. In: Perner, P. (ed.) ICDM 2006. LNCS, vol. 4065. Springer, Heidelberg (2006)
Bezdek, J.C.: Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum, New York (1981)
Bellman, R., Kalaba, R., Zadeh, L.A.: Abstraction and pattern classification. J. Math. Anal. Appl. 2, 581–585 (1966)
Bajcsy, R., Kovacic, S.: Multi-resolution elastic matching. Computer Vision Graphics Image Processing 46, 1–21 (1989)
Chiang, I.J., Hsu, J.Y.J.: Integration of fuzzy classifiers with decision trees. In: Proc. Asian Fuzzy Syst. Symp., pp. 266–271 (1996)
Chang, R.L.P., Pavlidis, T.: Fuzzy decision tree algorithms. IEEE Trans. Syst., Man, Cybern. 7, 28–35 (1977)
Carse, B., Fogarty, T.C., Munro, A.: Evolving fuzzy rule based controllers using genetic algorithms. Fuzzy Sets System 80, 273–293 (1996)
Ciesielski, K.: Set Theory for the Working Mathematician. Cambridge University Press, Cambridge (1997)
Cohen, W.: Fast effective rule induction. In: Proc. of ICML, pp. 115–123 (1995)
Chang, X.G., Lilly, J.H.: Evolutionary design of a fuzzy classifier from data. IEEE Transactions on Systems, Man, and Cybernatics-part B: Cybernetics 34(4), 1894–1906 (2004)
Dubois, D., Prade, H.: Rough fuzzy sets and fuzzy rough sets. Internat. J. General Systems 17(2-3), 191–209 (1990)
Dubois, D., Prade, H.: Putting fuzzy sets and rough sets together. In: Slowinski, R. (ed.) Intelligent Decision Support, pp. 203–232. Kluwer Academic, Dordrecht (1992)
Fernandez Salido, J.M., Murakami, S.: Rough set analysis of a general type of fuzzy data using transitive aggregations of fuzzy similarity relations. Fuzzy Sets and Systems 139, 635–660 (2003)
Furnkranz, J., Widmer, G.: Incremental reduced error pruning. In: Proc. of ICML, pp. 70–77 (1994)
Feng, X.H.: Extraction of Fuzzy Rules from Fuzzy Decision Trees: An Axiomatic Fuzzy Sets, Master Degree Thesis, Dalian Maritime university (2007)
Graver, J.E., Watkins, M.E.: Combinatorics with Emphasis on the Theory of Graphs. Springer, New York (1977)
Grenander, U.: General Pattern Theory. Oxford University Press, Oxford (1993)
Girolami, M.: Mercer kernel-based clustering in feature space. IEEE Transactions on Neural Networks 13, 780–784 (2002)
Huang, Z.H., Gedeon, T.D., Nikravesh, M.: Pattern Trees Induction: A New Machine Learning Method. Springer, New York (1974)
Hu, B.Q., Wang, S.: A novel approach to fuzzy programming part I: New arithmetic and order relations for interval numbers. Journal of Industrial and Management Optimization 2, 351–372 (2006)
Hu, B.Q., Wang, S.: A novel approach to fuzzy programming part II: A class of constrained nonlinear programming problems with interval objective functions. Journal of Industrial and Management Optimization 2, 373–386 (2006)
Hayashi, I.: Acquisition of fuzzy rules using fuzzy ID3 with ability of learning. In: Proc. ANZIIS 1996, pp. 187–190 (1996)
Hayashi, I., Maeda, T., Bastian, A., Jain, L.C.: Generation of fuzzy decision trees by fuzzy ID3 with adjusting mechanism of and/or operators. In: Proc. Int. Conf. Fuzzy Syst., pp. 681–685 (1998)
Halgamuge, S.K., Poechmueller, W., Glesner, M.: An alternative approach for generation of membership functions and fuzzy rules based on radial and cubic basis function networks. Int. J. Approx. Reas. 12, 279–298 (1995)
Halmos, P.R.: Measure theory. Springer, New York (1974)
Hartley, R.V.: Transmission of information. Bell Syst. Tech. J. 7, 535–563 (1928)
Ishibuchi, H., Nozaki, K., Yamamoto, N., Tanaka, H.: Selecting fuzzy if-then rules for classification problems using genetic algorithms. IEEE Trans. Fuzzy Syst. 3, 260–270 (1995)
Ichihashi, H., Shirai, T., Nagasaka, K., Miyoshi, T.: Neuro fuzzy ID3: A method of inducing fuzzy decision trees with linear programming for maximizing entropy and algebraic methods. Fuzzy Sets System 81(1), 157–167 (1996)
Ishibuchi, H., Nakashima, T., Murata, T.: Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems. IEEE Transactions on Systems, Man, and Cybernatics-part B: Cybernetics 29(5), 601–618 (1999)
Jain, A.K., Duin, R.P.W., Mao, J.C.: Statistical pattern recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 4–37 (2000)
Janikow, C.Z.: Fuzzy decision trees: Issues and Methods. IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics 28(1), 1–14 (1998)
Jain, A.K., Mao, J., Mohiuddin, K.M.: Artificial neural networks. Computer, 628–633 (1996)
Keller, J.M., Gray, M., Givens, J.: A fuzzy k-nearest neighbor algorithm. IEEE Trans.Syst., Man, Cybern. 15, 580–585 (1985)
Kim, K.H.: Boolean matrix Theory and Applications. Marcel Dekker, New York (1982)
Kosko, B.: Fuzzy Engineering. Prentice Hall, New Jersey (1998)
Kohonen, T.: Self-Organization and Associative Memory. Springer, Berlin (1989)
Kohonen, I.: Self-Organizing Maps. Springer Series in Information Sciences, vol. 30, Berlin (1995)
Kosko, B.: Fuzzy entropy and conditioning. Inform. Sci. 40, 165–174 (1986)
Liu, X.D.: The fuzzy theory based on AFS algebras and AFS structure. Journal of Mathematical Analysis and Applications 217, 459–478 (1998)
Liu, X.D.: The topology on AFS algebra and AFS structure. Journal of Mathematical Analysis and Applications 217, 479–489 (1998)
Liu, X.D.: The structure of fuzzy matrices. Journal of Fuzzy Mathematics 2, 311–325 (1994)
Liu, X.D.: The fuzzy sets and systems based on AFS structure, EI algebra and EII algebra. Fuzzy Sets and Systems 95, 179–188 (1998)
Liu, X.D.: A new fuzzy model of pattern recognition and hitch diagnoses of complex systems. Fuzzy Sets and Systems 104, 289–297 (1999)
Liu, X.D., Zhang, Q.L.: AFS Fuzzy logic and its applications to fuzzy information processing. Dongbei Daxue Xuebao 23, 321–323 (2002) (in Chinese)
Liu, X.D., Pedrycz, W., Zhang, Q.L.: Axiomatics fuzzy sets logic. In: IEEE International Conference on Fuzzy Systems, vol. 1, pp. 55–60 (2003)
Liu, X.D., Zhang, Q.L.: The EI algebra representations of fuzzy concept. Fuzzy Systems and Mathematics 16, 27–35 (2002)
Liu, X.D., Zhu, K.J., Huang, H.Z.: The representations of fuzzy concepts based on the fuzzy matrix theory and the AFS theory. In: IEEE International Symposium on Intelligent Control, Texas, USA, October 5–8 (2003)
Liu, X.D., Liu, W.Q.: The Framework of Axiomatics Fuzzy Sets Based Fuzzy Classifiers. Journal of Industrial and Mangenment Optimization 4(3), 581–609 (2008)
Liu, X.D., Wang, W., Chai, T.Y.: The Fuzzy Clustering Analysis Based on AFS Theory. IEEE Transactions on Systems, Man and Cybernetics Part B 35(5), 1013–1027 (2005)
Liu, X.D., Liu, W.Q.: Credit Rating Analysis with AFS Fuzzy Logic. In: Proceedings o f the Second International Conference on Fuzzy Systems and Knowledge Discovery, Changsha, China, August 27-29, 2005, pp. 1198–1204 (2005)
Liu, X.D., Chai, T.Y., Wang, W.: Approaches to the Representations and Logic Operations for Fuzzy Concepts in the Framework of Axiomatic Fuzzy Set Theory I, II. Information Sciences 177, 1007–1026, 1027–1045 (2007)
Liu, X.D., Pedrycz, W.: The Development of Fuzzy Decision Trees in the Framework of Axiomatic Fuzzy Set Logic. Applied Soft Computing 7, 325–342 (2007)
Liu, X.D.: The Development of AFS Theory Under Probability Theory. International Journal of Information and Systems Sciences 3(2), 326–348 (2007)
Liu, X.D., Liu, W.Q., Yang, B., Yan, H.: A New Framework of Axiomatic Fuzzy Set Classifiers via Entropy Analysis. Pattern Recognition (submitted)
Liu, X.D., Feng, X.H., Pedrycz, W.: Extraction of Fuzzy Rules from Fuzzy Decision Trees: An Axiomatic Fuzzy Sets. Knowledge and Data Engineering (submitted)
Liu, B., Hsu, W., Ma, Y.: Integrating classification and association rule mining. In: Proc. of SIGKDD, pp. 80–86 (1998)
Li, W.M., Han, J.W., Pei, J.: Accurate and Efficient Classification Based on Multiple Class-Association Rules. In: Proc. of ICDM, pp. 369–376 (2001)
Lee, H.M., Chen, C.M., Chen, J.M., Jou, Y.L.: An Efficient Fuzzy Classifier with feature Selection Based on Fuzzy Entropy. IEEE Transactions on Systems, Man, And Cybernetics-Part B: Cybernetics 31(3), 25–40 (2001)
Mizumoto, M.: Fuzzy controls under various fuzzy reasoning methods. Information Sciences 45, 129–151 (1988)
Maher, P.E., Clair, D.S.: Uncertain reasoning in an ID3 machine learning framework. In: Proc. IEEE ICFS 1993, pp. 7–12 (1993)
Michalski, R.S.: Understanding the nature of learning. In: Michalski, R., Carbonell, J., Mitchell, T. (eds.) Machine Learning: An Artificial Intelligence Approach, vol. 2, pp. 3–26. Morgan Kaufmann, San Mateo (1986)
Mitra, S., Konwar, K.M., Sankar, K.P.: Fuzzy decision tree, linguistic rules and fuzzy knowledge-based network: generation and evaluation. IEEE Transactions an Systems, Man, and Cybernetics–Part C: Applic. and Reviews 32(4), 328–339 (2002)
Mitchell, T.M.: Machine Learning. McGraw-Hill, New York (1997)
Mitra, S., Pal, S.K.: Self-organizing neural network as a fuzzy classifier. IEEE Trans. Syst., Man, Cybern. 24, 385–399 (1994)
Merz, C.J., Murphy, P.M.: UCI Repository for Machine Learning Data-Bases. Dept. of Information and Computer Science, University of California, Irvine, CA (1996), http://www.ics.uci.edu/~mlearn/MLRepository.html
Nozaki, K., Ishibuchi, H., Tanaka, H.: Adaptive fuzzy rule-based classification systems. IEEE Trans. Fuzzy Syst. 4, 238–250 (1996)
Pedrycz, W., Sosnowski, Z.A.: The design of decision trees in the framework of granular data and their application to software quality models. Fuzzy Sets and Systems 123, 271–290 (2001)
Pedrycz, W., Vukovich, G.: Logic-oriented fuzzy clustering. Pattern Recognition Letters 23, 1515–1527 (2002)
Pal, S.K., Mitra, S.: Multilayer perceptron, fuzzy sets, and classification. IEEE Trans. Neural Networks 3, 683–697 (1992)
Pedrycz, W., Sosnowski, Z.A.: Designing decision trees with the use of fuzzy granulation. IEEE Trans. Syst., Man, Cybern. part A 30, 151–159 (2000)
Perlovsky, L.I.: Conundrum of combinatorial complexity. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 666–670 (1998)
Pao, Y.H.: Adaptive Patter-Recognition and Neural Network. Addison-Wesley, Reading (1989)
Pedrycz, W., Sosnowski, Z.A.: C-fuzzy decision trees. IEEE Transactions on Systems, Man, cybernetics, Part C: Applications and Reviews 35(4), 498–511 (2005)
Pawlak, Z.: Rough set. International Journal of Computer and Information Sciences 11, 341–356 (1982)
Pedrycz, W.: Fuzzy neural networks with reference neurons as pattern classifiers. IEEE Trans. Neural Networks 3, 770–775 (1992)
Pal, S.K., Chakraborty, B.: Fuzzy set theoretic measure for automatic feature evaluation. IEEE Trans. Syst., Man, Cybern. 16, 754–760 (1986)
Quinlan, J.: C4.5: Programs for Machine Learning. Morgan Kaufmann, San Francisco (1993)
Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann, San Mateo (1993)
Quinlan, J.R.: Induction on decision trees. Mach. Learn. 1, 81–106 (1986)
Quinlan, J.R.: Decision trees as probabilistic classifiers. In: Proc. 4th Int. Workshop Machine Learning, pp. 31–37 (1987)
Quinlan, J.R.: Unknown attribute-values in induction. In: Proc. 6th Int. Workshop Machine Learning, pp. 164–168 (1989)
Radzikowska, A., Kerre, E.E.: A comparative study of fuzzy rough sets. Fuzzy Sets and Systems 126, 137–155 (2004)
Ruspini, E.H.: A new approach to clustering. Information and Control 15, 22–32 (1969)
Roubos, J.A., Setnes, M., Abonyi, J.: Learning fuzzy classification rules from labeled data. Information Sciences 150, 77–93 (2003)
Roubos, H., Setnes, M.: Compact and transparent fuzzy models and classifiers through iterative complexity reduction. IEEE Transations on Fuzzy Systems 9, 516–524 (2001)
Roberts, S.J., Everson, R., Rezek, I.: Maximum certainty data partitioning. Pattern Recognition 33, 833–839 (2000)
Ren, Y., Song, M.L., Liu, X.D.: New approaches to the fuzzy clustering via AFS theory. International Journal of Information and Systems Sciences 3(2), 307–325 (2007)
Radzikowska, A.M., Kerre, E.E.: A comparative study of fuzzy rough sets. Fuzzy Sets and Systems 126, 137–155 (2002)
Renyi, A.: On the measure of entropy and information. In: Proc. Fourth Berkeley Symp. Math. Statistics Probability, vol. 1, pp. 541–561 (1961)
Schaffer, C.: Overfitting avoidance as bias. Mach. Learn. 10, 153–178 (1993)
Sestino, S., Dillon, T.: Using single-layered neural networks for the extraction of conjunctive rules and hierarchical classifications. J. Appl. Intell. 1, 157–173 (1991)
Schapire, R.E.: Theoretical views of boosting. In: Proc. of European Conference on Computational Learning Theory (EuroCOLT), pp. 1–10 (1999)
Setnes, M., Roubos, H.: GA-fuzzy modeling and classification: Complexity and Performance. IEEE Transactions on Fuzzy Systems 8(5), 509–522 (2000)
Shannon, C.E.: A mathematical theory of communication. Bell Syst. Tech. J. 27, 379–423 (1948)
Tsang, E.C.C., Wang, X.Z., Yeung, D.S.: Improving learning accuracy of fuzzy decision trees by hybrid neural networks. IEEE Trans. Fuzzy Syst. 8, 601–614 (2000)
Takagi, T., Sugeno, M.: Fuzzy identification of systems and its application to modeling and control. IEEE Transactions on Systems, Man, and Cybernetics-part B: Cybernetics 15, 116–132 (1985)
Uebele, V., Abe, S., Lan, M.S.: A neural-network-based fuzzy classifier. IEEE Trans. Syst., Man, Cybern. 25, 353–361 (1995)
Wang, G.J.: Theory of topological molecular lattices. Fuzzy Sets and Systems 47, 351–376 (1992)
Wang, X., Chen, B., Qian, G., Ye, F.: On the optimization of fuzzy decision trees. Fuzzy Sets System 112, 117–125 (2000)
Wang, X.Z., Yeung, D.S., Tsang, E.C.C.: A comparative study on heuristic algorithms for generating fuzzy decision trees. IEEE Transactions an Systems, Man, and Cybernetics–Part B: Cybernetics 31(2), 215–226 (2001)
Wang, L.D., Yen, J.: Extracting fuzzy rules for system modeling using a hybride of genetic algorithms and Kalman filter. Fuzzy Sets and Systems 101, 353–362 (1999)
Wiener, N.: Cybernetics. Wiley, New York (1961)
Xizhao, W., Hong, J.: On the handling of fuzziness for continuous valued attributes in decision tree generation. Fuzzy Sets System 99, 283–290 (1998)
Yang, B.: A New Framework of Axiomatic Fuzzy Set Classifiers via Entropy Analysis, Master Degree Thesis, Dalian Maritime university (2008)
Yao, Y.Y.: Semantics of fuzzy sets in rough set theory. In: Peters, J.F., Skowron, A., Dubois, D., Grzymała-Busse, J.W., Inuiguchi, M., Polkowski, L. (eds.) Transactions on Rough Sets II. LNCS, vol. 3135, pp. 297–318. Springer, Heidelberg (2004)
Yang, M.S.: A survey of fuzzy clustering. Math. Comput. Modelling 18, 1–16 (1993)
Yang, M.S., Ko, C.H.: On cluster-wise fuzzy regression analysis. IEEE Transactions Systems Man Cyberenet, Part B 27, 1–13 (1997)
Yuan, Y., Shaw, M.J.: Induction of fuzzy decision trees. Fuzzy Sets Syst. 69, 125–139 (1995)
Yeung, D.S., Wang, X.Z., Tsang, E.C.C.: Learning weighted fuzzy rules from examples with mixed attributes by fuzzy decision trees. In: Proc. IEEE Int. Conf. on Systems, Man, and Cybernetics, Tokyo, Japan, October 12-15, 1999, pp. 349–354 (1999)
Yin, X., Han, J.: CPAR: Classification based on predictive association rules. In: Proc. of SDM (2003)
Zadeh, L.A.: Fuzzy logic and approximate reasoning. Synthese 30, 407–428 (1975)
Zadeh, L.A.: A theory of approximate reasoning. In: Hayes, Michie, Mikulich (eds.) Machine Intelligence, vol. 9, pp. 149–194. Wiley, Chichester (1979)
Zadeh, L.A.: The role of fuzzy logic in the management of uncertainty in expert systems. Fuzzy Sets Syst. 11, 199–227 (1983)
Zadeh, L.A.: Fuzzy sets. Information and Control 8, 338–353 (1965)
Zadeh, L.A.: Fuzzy logic=computing with word. IEEE Transactions on Fuzzy Systems 4, 103–111 (1996)
Zhang, Y.J., Liang, D.Q., Tong, S.C.: On AFS Algebra Part I, II. Information Sciences 167, 263–286, 287-303 (2004)
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Liu, X., Pedrycz, W. (2009). AFS Fuzzy Classifiers. In: Axiomatic Fuzzy Set Theory and Its Applications. Studies in Fuzziness and Soft Computing, vol 244. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-00402-5_10
Download citation
DOI: https://doi.org/10.1007/978-3-642-00402-5_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-00401-8
Online ISBN: 978-3-642-00402-5
eBook Packages: EngineeringEngineering (R0)