A New Algorithm for Classification Based on Multi-classifiers Learning

  • Yifeng ZhengEmail author
  • Guohe Li
  • Wenjie Zhang
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 849)


Quality and quantity are the two key factors to influence the accuracy of classification. In order to improve the classification accuracy, in this paper, we propose a new algorithm, called CMCM (Classification based on Multiple Classifier Models), which consists of two classification models. In Model1, we mainly focus on the improvement of quality, thus the best attribute value from both the items and their complements in the training set is selected as the first item of a classification rule. While in Model2, quantity is taken into consideration, so it constructs two candidate sets and uses the one-versus-many strategy to generate several rules at one time. The experiment results show that: (1) Model1 can extract sufficient high quality rules and achieve high classification accuracy. (2) Model2 can extract sufficient information and achieve high classification accuracy. (3) CMCM can achieve higher classification accuracy compare with traditional classification.


Data mining Classification Ensemble learning Classification rule 



This work is supported by Natural Science Funds of China (Nos. 61701213), Scientific Research Foundation for the Returned Overseas Chinese Scholars, State Education Ministry, the Program for Excellent Talents of Fujian Province, the Special Research Fund for Higher Education of Fujian (No. JK2015027), and the Research Fund for Educational Department of Fujian Province (No. JA15300).


  1. 1.
    Dong, G., Zhang, X., Wong, L., Li, J.: CAEP: classification by aggregating emerging patterns. In: Arikawa, S., Furukawa, K. (eds.) DS 1999. LNCS (LNAI), vol. 1721, pp. 30–42. Springer, Heidelberg (1999). Scholar
  2. 2.
    Veloso, A., Meira Jr., W., Zaki, M.J.: Lazy associative classification. In: ICDM 2006, pp. 645–654 (2006)Google Scholar
  3. 3.
    Clark, P., Boswell, R.: Rule induction with CN2: some recent improvements. In: Kodratoff, Y. (ed.) EWSL 1991. LNCS, vol. 482, pp. 151–163. Springer, Heidelberg (1991). Scholar
  4. 4.
    Brin, S., Motwani, R., Silverstein, C.: Beyond market: generalizing association rules to correlations. In: SIGMOD 1997, pp. 265–276 (1997)Google Scholar
  5. 5.
    Liu, B., Hsu, W., Ma, Y.: Integrating classification and association rule mining. In: KDD 1998, pp. 80–86 (1998)Google Scholar
  6. 6.
    Liu, R., Yuan, B.: Multiple classifiers combination by clustering and selecting. Inf. Fus. 2(2001), 163–168 (2001)CrossRefGoogle Scholar
  7. 7.
    Windeatt, T.: Diversity measures for multiple classifier system analysis and design. Inf. Fus. 6(2005), 21–36 (2005)CrossRefGoogle Scholar
  8. 8.
    Quinlan, J.R., Cameron-Jones, R.M.: FOIL: a midterm report. In: Brazdil, Pavel B. (ed.) ECML 1993. LNCS, vol. 667, pp. 1–20. Springer, Heidelberg (1993). Scholar
  9. 9.
    An, A.: Learning classification rules from data. Int. J. Comput. Math. Appl. 45(2003), 737–748 (2003)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Li, W., Han, J., Pei, J.: CMAR: accurate and efficient classification based on multiple class-association rules. In: ICDM 2001, pp. 369–376 (2001)Google Scholar
  11. 11.
    Zheng, Y., Huang, Z., He, T.: Classification based on both attribute value weight and tuple weight under the cloud computing. Math. Prob. Eng. 2013(2013), 1–7 (2013)Google Scholar
  12. 12.
    Zhou, Z.H.: Ensemble Methods: Foundations and Algorithms, p. 2012. CRC, Boca Raton (2012)CrossRefGoogle Scholar
  13. 13.
    Yin, X., Han, J.: CPAR: classification based on predictive association rules. In: Proceedings of the 2003 Society for Industrial and Applied Mathematics (SIAM) International Conference on Data Mining (2003)CrossRefGoogle Scholar
  14. 14.
    Wang, G., Sun, J., Ma, J., Xue, K., Gud, J.: Sentiment classification: the contribution of ensemble learning. Decis. Support Syst. 57(2014), 77–93 (2014)CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.School of Computer Sciences, Key Laboratory of Data Science and Intelligence ApplicationFujian Province University, Minnan Normal UniversityZhangzhouChina
  2. 2.College of Geophysics and Information Engineering, Beijing Key Lab of Data Mining for Petroleum Data UniversityChina University of PetroleumBeijingChina

Personalised recommendations