, Volume 28, Issue 2, pp 369–398 | Cite as

Robust inference for nonlinear regression models

  • Ana M. BiancoEmail author
  • Paula M. Spano
Original Paper


A family of weighted estimators of the regression parameter under a nonlinear model is introduced. The proposed weighted estimators are computed through a four-step MM-procedure, and the given approach allows for possible missing responses. Under mild conditions, the proposed estimators turn to be consistent and asymptotically normal. A robust Wald-type test statistic based on this family of estimators is also provided, and its asymptotic distribution is derived under the null and contiguous hypotheses. The local robustness of the proposed procedures is studied via the influence function analysis, and the finite sample behaviour of the estimators and tests is investigated through a Monte Carlo study in different contaminated scenarios. An application to an environmental data set illustrates the procedure.


Nonlinear regression MM-procedure Robust estimation Robust hypothesis testing Missing at random 

Mathematics Subject Classification

MSC 62F35 MSC 62F10 MSC 62F03 



The authors thank the anonymous referees for their comments and suggestions that helped to improve the presentation. This research was partially supported by Grants pip 112-201101-00339 from conicet, pict 2014-0351 from anpcyt and 20020130100279ba from the Universidad de Buenos Aires at Buenos Aires, Argentina.

Supplementary material

11749_2017_570_MOESM1_ESM.pdf (1.7 mb)
Supplementary material 1 (pdf 1746 KB)


  1. Anthony M, Bartlett P (1999) Neural network learning: theoretical foundations. Cambridge University Press, CambridgeCrossRefzbMATHGoogle Scholar
  2. Bates DM, Watts DG (2007) Nonlinear regression analysis and its applications. Wiley, New YorkzbMATHGoogle Scholar
  3. Bianco A, Boente G (2002) On the asymptotic behavior of one-step estimates in heteroscedastic regression models. Stat Probab Lett 60:33–47MathSciNetCrossRefzbMATHGoogle Scholar
  4. Bianco A, Boente G (2004) Robust estimators in semiparametric partly linear regression models. J Stat Plan Inference 122:229–252MathSciNetCrossRefzbMATHGoogle Scholar
  5. Bianco A, Boente G, Rodrigues I (2013) Resistant estimators in Poisson and Gamma models with missing responses and an application to outlier detection. J Multivar Anal 114:209–226MathSciNetCrossRefzbMATHGoogle Scholar
  6. Chen Q, Ibrahim J, Chen M, Senchaudhuri P (2008) Theory and inference for regression models with missing responses and covariates. J Multivar Anal 99:1302–1331MathSciNetCrossRefzbMATHGoogle Scholar
  7. Čížek P (2006) Least trimmed squares in nonlinear regression under dependence. J Stat Plan Inference 136:3967–3988MathSciNetCrossRefzbMATHGoogle Scholar
  8. Cleveland W (1985) The elements of graphing data. Bell Telephone Laboratories Inc., New JerseyGoogle Scholar
  9. Croux C (1994) Efficient high-breakdown \(M-\)estimators of scale. Stat Probab Lett 19:371–379MathSciNetCrossRefzbMATHGoogle Scholar
  10. Croux C, Fekri M, Ruiz-Gazen A (2010) Fast and robust estimation of the multivariate errors in variables model. Test 19:286–303MathSciNetCrossRefzbMATHGoogle Scholar
  11. Currie DJ (1982) Estimating Michaelis–Menten parameters: bias, variance and experimental design. Biometrics 38:907–919CrossRefzbMATHGoogle Scholar
  12. Fasano V (2009) Teoría asintótica de estimadores robustos en regresión lineal. Doctoral thesis, Universidad Nacional de la Plata.
  13. Fasano V, Maronna R, Sued M, Yohai V (2012) Continuity and differentiability of regression M functionals. Bernoulli 18:1284–1309MathSciNetCrossRefzbMATHGoogle Scholar
  14. Filzmoser P (2010) Soft methods in robust statistics. In: Borgelt C, González Rodríguez G, Trutschnig W, Lubiano MA, Gil MA, Grzegorzewski P, Hryniewicz O (eds) Combining soft computing and statistical methods in data analysis, vol 77. Springer, Heidelberg, pp 273–280CrossRefGoogle Scholar
  15. Fraiman R (1983) General M-estimators and applications to bounded influence estimation for non-linear regression. Commun Stat Theory Methods 22:2617–2631MathSciNetCrossRefzbMATHGoogle Scholar
  16. Gallant A (1975) Nonlinear regression. Am Stat 29:73–81MathSciNetzbMATHGoogle Scholar
  17. Hampel F, Ronchetti E, Rousseeuw P, Stahel W (1986) Robust statistics: the approach based on influence functions. Wiley, New YorkzbMATHGoogle Scholar
  18. Heritier S, Ronchetti E (1994) Robust bounded-influence tests in general parametric models. J. Am. Stat. Assoc. 89:897–904MathSciNetCrossRefzbMATHGoogle Scholar
  19. Huber P (1967) The behavior of maximum likelihood estimates under nonstandard conditions. In: Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, Vol 1, pp 221–233Google Scholar
  20. Koul H, Müller U, Schick A (2012) The transfer principle: a tool for complete case analysis. Ann. Stat. 40:3031–3049MathSciNetCrossRefzbMATHGoogle Scholar
  21. Liu R, Markatou M, Tsai C (2005) Robust estimation and testing in nonlinear regression models. Int J Pure Appl Math 21:525–552MathSciNetzbMATHGoogle Scholar
  22. Markatou M, Manos G (1996) Robust tests in nonlinear regression models. J Stat Plan Inference 55:205–217MathSciNetCrossRefzbMATHGoogle Scholar
  23. Maronna R, Martin D, Yohai V (2006) Robust statistics: theory and methods. Wiley, New YorkCrossRefzbMATHGoogle Scholar
  24. Maronna R, Yohai VJ (2010) Correcting MM-estimates for fat data sets. J Comput Stat Data Anal 54:3168–3173MathSciNetCrossRefzbMATHGoogle Scholar
  25. Mukherjee K (1996) Robust estimation in nonlinear regression via minimum distance method. Math Methods Stat 5:99–112MathSciNetzbMATHGoogle Scholar
  26. Müller U (2009) Estimating linear functionals in nonlinear regression with responses missing at random. Ann Stat 37:2245–2277MathSciNetCrossRefzbMATHGoogle Scholar
  27. Pakes A, Pollard D (1989) Simulation and the asymptotics of optimization estimators. Econometrica 57:1027–1057MathSciNetCrossRefzbMATHGoogle Scholar
  28. Rieder H (1978) A robust asymptotic testing model. Ann Stat 6:1080–1994MathSciNetCrossRefzbMATHGoogle Scholar
  29. Sakata S, White H (2001) \(S\)-estimation of nonlinear regression models with dependent and heterogeneous observations. J Econom 103:5–72MathSciNetCrossRefzbMATHGoogle Scholar
  30. Seber G, Wild C (2003) Nonlinear regression. Wiley, New YorkzbMATHGoogle Scholar
  31. Spano P (2016) Inferencia robusta en modelos no lineales con respuestas faltantes. Unpublished Doctoral Thesis.
  32. Stromberg A (1993) Computation of high breakdown nonlinear regression parameters. J Am Stat Assoc 88:237–244zbMATHGoogle Scholar
  33. Stromberg A, Ruppert D (1992) Breakdown in nonlinear regression. J Am Stat Assoc 87:991–997MathSciNetCrossRefzbMATHGoogle Scholar
  34. Sued M, Yohai V (2013) Robust location estimation with missing data. Can J Stat 41:111–132MathSciNetCrossRefzbMATHGoogle Scholar
  35. Tabatabai M, Argyros I (1993) Robust estimation and testing for general nonlinear regression models. Appl Math Comput 58:85–101MathSciNetzbMATHGoogle Scholar
  36. Valdora M, Yohai VJ (2014) Robust estimators for generalized linear models. J Stat Plan Inference 146:31–48MathSciNetCrossRefzbMATHGoogle Scholar
  37. van de Geer S (2000) Empirical processes in \(M\)-estimation. Cambridge University Press, CambridgezbMATHGoogle Scholar
  38. van der Vaart A, Wellner J (1996) Weak convergence and empirical processes. Springer, New YorkCrossRefzbMATHGoogle Scholar

Copyright information

© Sociedad de Estadística e Investigación Operativa 2017

Authors and Affiliations

  1. 1.Instituto de Cálculo, Facultad de Ciencias Exactas y NaturalesUniversidad de Buenos Aires and CONICET, Ciudad UniversitariaBuenos AiresArgentina

Personalised recommendations