Classifiers Based on Two-Layered Learning

  • Jan G. Bazan
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3066)


In this paper we present an exemplary classifier (classification algorithm) based on two-layered learning. In the first layer of learning a collection of classifiers is induced from a part of original training data set. In the second layer classifiers are induced using patterns extracted from already constructed classifiers on the basis of their performance on the remaining part of training data. We report results of experiments performed on the following data sets, well known from literature: diabetes, heart disease, australian credit (see [5]) and lymphography (see [4]). We compare the standard rough set method used to induce classifiers (see [1] for more details), based on minimal consistent decision rules (see [6]), with the classifier based on two-layered learning.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bazan, J.: A comparison of dynamic non-dynamic rough set methods for extracting laws from decision tables. In: [7], pp. 321–365Google Scholar
  2. 2.
    Bazan, J., Nguyen, H.S., Skowron, A., Szczuka, M.: A view on rough set concept approximation. In: Wang, G., Liu, Q., Yao, Y., Skowron, A. (eds.) RSFDGrC 2003. LNCS (LNAI), vol. 2639, pp. 181–188. Springer, Heidelberg (2003)Google Scholar
  3. 3.
    Friedman, J.H., Hastie, T., Tibshirani, R.: The elements of statistical learning: Data mining, inference, and prediction. Springer, Heidelberg (2001)zbMATHGoogle Scholar
  4. 4.
    Grzymała-Busse, J.: A New Version of the Rule Induction System LERS. Fundamenta Informaticae 31(1), 27–39 (1997)zbMATHGoogle Scholar
  5. 5.
    Michie, D., Spiegelhalter, D.J., Taylor, C.C.: Machine learning, neural and statistical classification. Ellis Horwood, New York (1994)zbMATHGoogle Scholar
  6. 6.
    Pawlak, Z.: Rough sets: Theoretical aspects of reasoning about data. Kluwer, Dordrecht (1991)zbMATHGoogle Scholar
  7. 7.
    Polkowski, L., Skowron, A. (eds.): Rough Sets in Knowledge Discovery, vol. 1-2. Physica-Verlag, Heidelberg (1998)Google Scholar
  8. 8.
    The RSES Homepage –

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Jan G. Bazan
    • 1
  1. 1.Institute of MathematicsUniversity of RzeszówRzeszówPoland

Personalised recommendations