Combinatorial Tools

  • Luc Devroye
  • Gábor Lugosi
Part of the Springer Series in Statistics book series (SSS)


Consider a class A of subsets of R d , and let x 1,…,x n R d be arbitrary points. Recall from the previous chapter that properties of the finite set A(x 1 n ) ⊂ {0, 1} n defined by
$$ A(x_1^n) = \{ b = ({b_1}, \ldots ,{b_n}) \in {\{ 0,1\} ^n}:\exists A \in A:{b_i} = {1_{[{x_i} \in A]}},i = 1, \ldots ,n\}$$
play an essential role in bounding uniform deviations of the empirical measure.


Dimension Versus Binomial Theorem Packing Number Combinatorial Tool Uniform Deviation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

§4.7. References

  1. S. Alesker, “A remark on the Szarek-Talagrand theorem,” Combinatorics, Probability, and Computing, vol. 6, pp. 139–144, 1997.MathSciNetMATHCrossRefGoogle Scholar
  2. N. Alon, S. Ben-David, N. Cesa-Bianchi, and D. Haussler, “Scale-sensitive dimensions, uniform convergence, and learnability,” Journal of the ACM, vol. 44, pp. 615–631, 1997.MathSciNetMATHCrossRefGoogle Scholar
  3. M. Anthony and P. L. Bartlett, Neural Network Learning: Theoretical Foundations, Cambridge University Press, Cambridge, 1999.MATHCrossRefGoogle Scholar
  4. P. Assouad, “Sur les classes de Vapnik-Chervonenkis,” Comptes Rendus des Séances de l’Académie des Sciences. Série I, vol. 292, pp. 921–924, 1981.MathSciNetMATHGoogle Scholar
  5. N. Cesa-Bianchi and D. Haussler, “A graph-theoretic generalization of the Sauer-Shelah lemma,” Discrete Applied Mathematics, vol. 86, pp. 27–35, 1998.MathSciNetMATHCrossRefGoogle Scholar
  6. T. M. Cover, “Geometrical and statistical properties of systems of linear inequalities with applications in pattern recognition,” IEEE Transactions on Electronic Computers, vol. 14, pp. 326–334, 1965.MATHCrossRefGoogle Scholar
  7. R. M. Dudley, “Central limit theorems for empirical measures,” Annals of Probability, vol. 6, pp. 899–929, 1978.MathSciNetMATHCrossRefGoogle Scholar
  8. R. M. Dudley, “Balls in R k do not cut all subsets of k + 2 points,” Advances in Mathematics, vol. 31(3), pp. 306–308, 1979.MathSciNetMATHCrossRefGoogle Scholar
  9. P. Frankl, “On the trace of finite sets,” Journal of Combinatorial Theory, Series A, vol. 34, pp. 41–45, 1983.MathSciNetMATHCrossRefGoogle Scholar
  10. D. Haussler, “Sphere packing numbers for subsets of the Boolean n-cube with bounded Vapnik-Chervonenkis dimension,” Journal of Combinatorial Theory, Series A, vol. 69, pp. 217–232, 1995.MathSciNetMATHCrossRefGoogle Scholar
  11. N. Sauer, “On the density of families of sets,” Journal of Combinatorial Theory Series A, vol. 13, pp. 145–147, 1972.MathSciNetMATHCrossRefGoogle Scholar
  12. L. Schläffli, Gesammelte Mathematische Abhandlungen, Birkhäuser-Verlag, Basel, 1950.Google Scholar
  13. S. Shelah, “A combinatorial problem: Stability and order for models and theories in infinity languages,” Pacific Journal of Mathematics, vol. 41, pp. 247–261, 1972.MathSciNetMATHGoogle Scholar
  14. J. M. Steele, “Combinatorial entropy and uniform limit laws,” PhD dissertation, Stanford University, Stanford, CA, 1975.Google Scholar
  15. J. M. Steele, “Existence of submatrices with all possible columns,” Journal of Combinatorial Theory, Series A, vol. 28, pp. 84–88, 1978.MathSciNetCrossRefGoogle Scholar
  16. S. J. Szarek and M. Talagrand, “On the convexified Sauer-Shelah theorem,” Journal of Combinatorial Theory, Series B, vol. 69, pp. 183–192, 1997.MathSciNetMATHCrossRefGoogle Scholar
  17. V. N. Vapnik and A. Ya. Chervonenkis, “On the uniform convergence of relative frequencies of events to their probabilities,” Theory of Probability and its Applications, vol. 16, pp. 264–280, 1971.MATHCrossRefGoogle Scholar
  18. R. S. Wenocur and R. M. Dudley, “Some special Vapnik-Chervonenkis classes,” Discrete Mathematics, vol. 33, pp. 313–318, 1981.MathSciNetMATHCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2001

Authors and Affiliations

  • Luc Devroye
    • 1
  • Gábor Lugosi
    • 2
  1. 1.Computer Science DepartmentMcGill UniversityMontrealCanada
  2. 2.Facultat de Ciencies EconomiquesUniversitat Pompeu FabraBarcelonaSpain

Personalised recommendations