Abstract
We present results concerning the learning of Monotone DNF (MDNF) from Incomplete Membership Queries and Equivalence Queries. Our main result is a new algorithm that allows efficient learning of MDNF using Equivalence Queries and Incomplete Membership Queries with probability of \( p = 1 - 1/poly\left( {n,t} \right) \) of failing. Our algorithm is expected to make
queries, when learning a MDNF formula with t terms over n variables. Note that this is polynomial for any failure probability p = 1-1/poly(n, t). The algorithm’s running time is also polynomial in t, n, and 1/(1-{tip}). In a sense this is the best possible, as learning with p = 1-1/ω(poly(n, t)) would imply learning MDNF, and thus also DNF, from equivalence queries alone.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
D. Angluin. Queries and concept learning. Machine Learning, 2(4):319–342, April 1988.
Dana Angluin and Donna K. Slonim. Randomly fallible teachers: Learning monotone DNF with an incomplete membership oracle. Machine Learning, 14:7–26, 1994.
P. Auer. On-line learning of rectangles in noisy environments. In Proc. 6th Annu. Conf. on Comput. Learning Theory, pages 253–261. ACM Press, New York, NY, 1993.
Peter Auer and Nicolò Cesa-Bianchi. On-line learning with malicious noise and the closure algorithm. Annals of Mathematics and Artificial Intelligence, 23(1/2):83–99, 1998. Special issue for AII’ 94 and ALT’ 94.
Z. Chen. Anote on learning DNF formulas using equivalence and incomplete membership queries. In Proc. 5th Int. Workshop on Algorithmic Learning Theory, pages 272–281. Springer-Verlag, 1994.
S.A. Goldman and H.D. Mathias. Learning k-term DNF formulas with an incomplete membership oracle. In Proc. 5th Annu. Workshop on Comput. Learning Theory, pages 77–84. ACM Press, New York, NY, 1992.
N. Littlestone. Mistake Bounds and Logarithmic Linear-threshold Learning Algorithms. PhD thesis, Technical Report UCSC-CRL-89-11, University of California Santa Cruz, 1989.
N. Littlestone and M.K. Warmuth. The weighted majority algorithm. Inform. Comput., 108(2):212–261, 1994.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bshouty, N.H., Eiron, N. (2001). Learning Monotone DNF from a Teacher That Almost Does Not Answer Membership Queries. In: Helmbold, D., Williamson, B. (eds) Computational Learning Theory. COLT 2001. Lecture Notes in Computer Science(), vol 2111. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44581-1_36
Download citation
DOI: https://doi.org/10.1007/3-540-44581-1_36
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42343-0
Online ISBN: 978-3-540-44581-4
eBook Packages: Springer Book Archive