Simple PAC learning of simple decision lists

  • Jorge Castro
  • José L. Balcázar
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 997)


We prove that log n-decision lists — the class of decision lists such that all their terms have low Kolmogorov complexity— are learnable in the simple PAG learning model. The proof is based on a transformation from an algorithm based on equivalence queries (found independently by Simon). Then we introduce the class of simple decision lists, and extend our algorithm to show that simple decision lists are simple-PAC learnable as well. This last result is relevant in that it is, to our knowledge, the first learning algorithm for decision lists in which an exponentially wide set of functions may be used for the terms.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Angluin, D.: Learning regular sets from queries and counterexamples. Information and Computation 75 (1987) 87–106CrossRefGoogle Scholar
  2. 2.
    Angluin, D.: Queries and concept learning. Machine Learning 2 (1988) 319–342Google Scholar
  3. 3.
    Castro, J.: A note on learning decision lists. Report de Recerca LSI-95-2-R, Dept. LSI, UPC (1995)Google Scholar
  4. 4.
    Li, M. and Vitányi, P.: Learning simple concepts under simple distributions. SIAM Journal of Computing 20 (1991) 911–935Google Scholar
  5. 5.
    Li, M. and Vitányi, P.: An introduction to Kolmogorov complexity and its applications. Springer-Verlag (1993)Google Scholar
  6. 6.
    Rivest, R.: Learning decision lists. Machine Learning 2 (1987) 229–246Google Scholar
  7. 7.
    Simon, H.U.: Learning decision lists an trees with equivalence queries. In Second European Conference, EuroCOLT'95, Barcelona (1995) 322–336. Lecture Notes in Artificial Intelligence.Google Scholar
  8. 8.
    Valiant, L.G.: A theory of the learnable. Comm. ACM 27 (1984) 1134–1142CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1995

Authors and Affiliations

  • Jorge Castro
    • 1
  • José L. Balcázar
    • 1
  1. 1.Dept. Llenguatges i Sistemes InformàticsUniversitat Politècnica de CatalunyaUSA

Personalised recommendations