Abstract
We consider the Boolean concept classes of 2-term DNF and 1-decision lists which both have a teaching dimension exponential in the number n of variables. It is shown that both classes have an average teaching dimension linear in n. We also consider learners that always choose a simplest consistent hypothesis instead of an arbitrary consistent one. Both classes can be taught to these learners by efficient teaching algorithms using only a linear number of examples.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Angluin, D.: Queries and concept learning. Machine Learning 2(4), 319–342 (1988)
Angluin, D.: Queries revisited. In: Abe, N., Khardon, R., Zeugmann, T. (eds.) ALT 2001. LNCS (LNAI), vol. 2225, pp. 12–31. Springer, Heidelberg (2001)
Angluin, D., Kriķis, M.: Teachers, learners and black boxes. In: Proceedings COLT 1997, pp. 285–297. ACM Press, New York (1997)
Angluin, D., Kriķis, M.: Learning from different teachers. Machine Learning 51(2), 137–163 (2003)
Anthony, M., Brightwell, G., Shawe-Taylor, J.: On specifying boolean functions by labelled examples. Discrete Applied Mathematics 61(1), 1–25 (1995)
Eiter, T., Ibaraki, T., Makino, K.: Decision lists and related Boolean functions. Theoretical Computer Science 270(1–2), 493–524 (2002)
Freivalds, R., Kinber, E.B., Wiehagen, R.: On the power of inductive inference from good examples. Theoretical Computer Science 110(1), 131–144 (1993)
Goldman, S.: Learning Binary Relations, Total Orders, and Read-Once Formulas. PhD thesis, MIT Dept. of Electr. Engineering and Computer Science (September 1990)
Goldman, S.A., Kearns, M.J.: On the complexity of teaching. J. of Comput. Syst. Sci. 50(1), 20–31 (1995)
Goldman, S.A., Mathias, H.D.: Teaching a smarter learner. J. of Comput. Syst. Sci. 52(2), 255–267 (1996)
Goldman, S.A., Rivest, R.L., Schapire, R.E.: Learning binary relations and total orders. SIAM J. Comput. 22(5), 1006–1034 (1993)
Hancock, T., Jiang, T., Li, M., Tromp, J.: Lower bound on learning decision lists and trees. Inform. Comput. 126(2), 114–122 (1996)
Hegedüs, T.: Generalized teaching dimensions and the query complexity of learning. In: Proceedings COLT 1995, pp. 108–117. ACM Press, New York (1995)
Jackson, J., Tomkins, A.: A computational model of teaching. In: Proceedings COLT 1992, pp. 319–326. ACM Press, New York (1992)
Jain, S., Lange, S., Nessel, J.: Learning of r.e. languages from good examples. In: Li, M. (ed.) ALT 1997. LNCS, vol. 1316, Springer, Heidelberg (1997)
Kuhlmann, C.: On teaching and learning intersection-closed concept classes. In: Fischer, P., Simon, H.U. (eds.) EuroCOLT 1999. LNCS (LNAI), vol. 1572, pp. 168–182. Springer, Heidelberg (1999)
Mathias, H.D.: A model of interactive teaching. J. of Comput. Syst. Sci. 54(3), 487–501 (1997)
Pitt, L., Valiant, L.G.: Computational limitations on learning from examples. J. ACM 35(4), 965–984 (1988)
Rivest, R.L.: Learning decision lists. Machine Learning 2, 229–246 (1987)
Shinohara, A., Miyano, S.: Teachability in computational learning. New Generation Computing 8(4), 337–348 (1991)
Simon, H.U.: Learning decision lists and trees with equivalence-queries. In: Proceedings EuroCOLT 1995. LNCS (LNAI), vol. 904, pp. 322–336. Springer, Heidelberg (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Balbach, F.J. (2005). Teaching Classes with High Teaching Dimension Using Few Examples. In: Auer, P., Meir, R. (eds) Learning Theory. COLT 2005. Lecture Notes in Computer Science(), vol 3559. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11503415_45
Download citation
DOI: https://doi.org/10.1007/11503415_45
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26556-6
Online ISBN: 978-3-540-31892-7
eBook Packages: Computer ScienceComputer Science (R0)