On Robust Recursive Nonparametric Curve Estimation

  • Eduard Belitser
  • Sara van de Geer
Conference paper
Part of the Progress in Probability book series (PRPR, volume 47)


Suppose we observe X k = θ(x k ) + ξ k . The function θ: [0,1] → ℝ, is assumed to belong a priori to a given nonparametric smoothness class, the ξ k ’s are independent identically distributed random variables with zero medians. The only prior information about the distribution of the noise is that it belongs to a rather wide class. The assumptions describing this class include cases in which no moments of the noises exist, so that linear estimation methods (for example, kernel methods) can not be applied. We propose a robust estimator based on a stochastic approximation procedure and derive its rate of convergence, as the frequency of observations n tends to infinity, in almost sure as well as in mean square sense, uniformly over the smoothness class Finally, we discuss a multivariate formulation of the problem, a robust nonparametric M-estimator (the least deviations estimator), the so called penalized estimator, and the case when the noises are not necessarily identically distributed.


Robust Estimator Multivariate Case Multivariate Formulation Linear Estimation Method Smoothness Class 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. E.N. Belitser, A.P. Korostelev (1992), Pseudovalues and minimax filtering algorithms for the nonparametric median, Adv. in Soy. Math. 12, 115–124. MathSciNetGoogle Scholar
  2. V.H. de la Peña, E. Giné (1999), Decoupling. Prom dependence to independence. Randomly stopped processes. U-statistics and processes. Martingales and beyond, Probability and its Applications. Springer-Verlag, New York.Google Scholar
  3. A.P. Korostelev (1987), Asymptotic minimax filtering of nonparametric signals, Technical report, Institute of System Studies, Moscow.Google Scholar
  4. C.J. Stone (1982), Optimal global rates of convergence for nonparametric regression, Ann Statist 10, 1040–1053.MathSciNetMATHCrossRefGoogle Scholar
  5. Y.K. Truong (1989), Asymptotic properties of kernel estimators based on local medians, Ann. Statist. 18, 606–617.MathSciNetCrossRefGoogle Scholar
  6. S. van de Geer (2000), Empirical Processes in M-estimation, Cambridge University Press, Cambridge, UK.Google Scholar
  7. S. van de Geer (1999), M-estimation using penalties or sieves, Technical Report MI 31–99, University of Leiden, to appear in JSPI.Google Scholar
  8. D. Williams (1991), Probability with Martingales, Cambridge University Press, Cambridge, UK.MATHCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2000

Authors and Affiliations

  • Eduard Belitser
    • 1
  • Sara van de Geer
    • 1
  1. 1.Mathematical InstituteLeiden UniversityLeidenThe Netherlands

Personalised recommendations