The New Palgrave Dictionary of Economics

2018 Edition
| Editors: Macmillan Publishers Ltd

Sieve Extremum Estimation

  • Xiaohong Chen
Reference work entry


Semi-nonparametric models are more flexible and robust than parametric models, but are more complex due to the presence of infinite dimensional unknown parameters. This article describes the method of sieve extremum estimation of semi-nonparametric models, which is a general method of optimizing an empirical criterion function over a sequence of approximating parameter spaces (that is, sieves). Widely used sieve spaces and criterion functions are presented as examples, including the sieve M-estimation, series estimation, and sieve minimum distance estimation as special cases. Existing results are cited on asymptotic properties and applications of the method.


ARCH models Artificial neural networks Chaos Engel curve Generalized method of moments Polynomials Maximum likelihood Measurement error models Nonparametric models Semi-nonparametric models Series estimation Sieve extremum estimation Sieve minimum distance Simultaneous equations Splines Spurious regressions Treatment effect Wavelets 

JEL Classifications

This is a preview of subscription content, log in to check access.


  1. Ai, C., and X. Chen. 2003. Efficient estimation of models with conditional moment restrictions containing unknown functions. Econometrica 71: 1795–1843.CrossRefGoogle Scholar
  2. Ai, C., and X. Chen. 2007. Estimation of possibly misspecified semiparametric conditional moment restriction models with different conditioning variables. Journal of Econometrics 141: 5–43.CrossRefGoogle Scholar
  3. Anastassiou, G., and X. Yu. 1992. Monotone and probabilistic wavelet approximation. Stochastic Analysis and Applications 10: 251–264.CrossRefGoogle Scholar
  4. Andrews, D. 1991a. Asymptotic optimality of generalized CL, cross-validation, and generalized cross-validation in regression with heteroskedastic errors. Journal of Econometrics 47: 359–377.CrossRefGoogle Scholar
  5. Andrews, D. 1991b. Asymptotic normality of series estimators for nonparametric and semiparametric regression models. Econometrica 59: 307–345.CrossRefGoogle Scholar
  6. Andrews, D., and Y. Whang. 1990. Additive interactive regression models: Circumvention of the curse of dimensionality. Econometric Theory 6: 466–479.CrossRefGoogle Scholar
  7. Barron, A.R. 1993. Universal approximation bounds for superpositions of a sigmoidal function. IEEE Transactions on Information Theory 39: 930–945.CrossRefGoogle Scholar
  8. Barron, A., L. Birgé, and P. Massart. 1999. Risk bounds for model selection via penalization. Probability of Theory Related Fields 113: 301–413.CrossRefGoogle Scholar
  9. Bierens, H., and J. Carvalho. 2007. Semi-nonparametric competing risks analysis of recidivism. Journal of Applied Econometrics 22: 971–993.CrossRefGoogle Scholar
  10. Birgé, L., and P. Massart. 1998. Minimum contrast estimators on sieves: Exponential bounds and rates of convergence. Bernoulli 4: 329–375.CrossRefGoogle Scholar
  11. Blundell, R., X. Chen, and D. Kristensen. 2007. Semi-nonparametric IV estimation of shape-invariant Engel curves. Econometrica 75: 1613–1669.CrossRefGoogle Scholar
  12. Blundell, R., and J. Powell. 2003. Endogeneity in nonparametric and semiparametric regression models. In Advances in economics and econometrics: theory and applications, ed. M. Dewatripont, L.P. Hansen, and S. Turnovsky. Cambridge: Cambridge University Press.Google Scholar
  13. Carrasco, M., J.-P. Florens, and E. Renault. 2006. Linear inverse problems in structural econometrics estimation based on spectral decomposition and regularization. In The handbook of econometrics, ed. J.J. Heckman and E.E. Leamer, Vol. 6. Amsterdam: North-Holland.Google Scholar
  14. Chen, X. 2006. Large sample sieve estimation of semi-nonparametric models. In The handbook of econometrics, ed. J.J. Heckman and E.E. Leamer, Vol. 6. Amsterdam: North-Holland.Google Scholar
  15. Chen, X., and T. Conley. 2001. A new semiparametric spatial model for panel time series. Journal of Econometrics 105: 59–83.CrossRefGoogle Scholar
  16. Chen, X., Y. Fan, and V. Tsyrennikov. 2006. Efficient estimation of semiparametric multivariate copula models. Journal of the American Statistical Association 101: 1228–1240.CrossRefGoogle Scholar
  17. Chen, X., H. Hong, and E. Tamer. 2005. Measurement error models with auxiliary data. Review of Economic Studies 72: 343–366.CrossRefGoogle Scholar
  18. Chen, X. and Ludvigson, S. 2003. Land of addicts? An empirical investigation of habit-based asset pricing models. Manuscript, New York University.Google Scholar
  19. Chen, X. and Pouzo, D. 2007. On estimation of semi-nonparametric conditional moment models with possibly nonsmooth moments. Manuscript, New York University.Google Scholar
  20. Chen, X., J. Racine, and N. Swanson. 2001. Semiparametric ARX neural network models with an application to forecasting inflation. IEEE Transactions on Neural Networks 12: 674–683.CrossRefGoogle Scholar
  21. Chen, X., and X. Shen. 1998. Sieve extremum estimates for weakly dependent data. Econometrica 66: 289–314.CrossRefGoogle Scholar
  22. Chen, X., and H. White. 1999. Improved rates and asymptotic normality for nonparametric neural network estimators. IEEE Transactions on Information Theory 45: 682–691.CrossRefGoogle Scholar
  23. Chernozhukov, V., G. Imbens, and W. Newey. 2007. Instrumental variable identification and estimation of nonseparable models via quantile conditions. Journal of Econometrics 139: 4–14.CrossRefGoogle Scholar
  24. Chui, C. 1992. An introduction to wavelets. San Diego: Academic Press.Google Scholar
  25. Coppejans, M., and A.R. Gallant. 2002. Cross-validated SNP density estimates. Journal of Econometrics 110: 27–65.CrossRefGoogle Scholar
  26. Darolles, S., J.-P. Florens, and E. Renault. 2006. Nonparametric instrumental regression. Mimeo: GREMAQ, University of Toulouse.Google Scholar
  27. de Boor, C. 1978. A practical guide to splines. New York: Springer.CrossRefGoogle Scholar
  28. DeVore, R.A., and G.G. Lorentz. 1993. Constructive approximation. Berlin: Springer.CrossRefGoogle Scholar
  29. Donald, S., and W. Newey. 2001. Choosing the number of instruments. Econometrica 69: 1161–1191.CrossRefGoogle Scholar
  30. Donoho, D.L., I.M. Johnstone, G. Kerkyacharian, and D. Picard. 1995. Wavelet shrinkage: Asymptopia? Journal of the Royal Statistical Society, Series B 57: 301–369.Google Scholar
  31. Elbadawi, I., A.R. Gallant, and G. Souza. 1983. An elasticity can be estimated consistently without a prior knowledge of functional form. Econometrica 51: 1731–1751.CrossRefGoogle Scholar
  32. Engle, R., and G. Gonzalez-Rivera. 1991. Semiparametric ARCH models. Journal of Business and Economic Statistics 9: 345–359.Google Scholar
  33. Engle, R., C. Granger, J. Rice, and A. Weiss. 1986. Semiparametric estimates of the relation between weather and electricity sales. Journal of the American Statistical Association 81: 310–320.CrossRefGoogle Scholar
  34. Florens, J.P. 2003. Inverse problems and structural econometrics: The example of instrumental variables. In Advances in economics and econometrics: theory and applications, ed. M. Dewatripont, L.P. Hansen, and S. Turnovsky. Cambridge: Cambridge University Press.Google Scholar
  35. Gallant, A.R., and D. Nychka. 1987. Semi-non-parametric maximum likelihood estimation. Econometrica 55: 363–390.CrossRefGoogle Scholar
  36. Gallant, A.R., and G. Tauchen. 1989. Semiparametric estimation of conditional constrained heterogenous processes: Asset pricing applications. Econometrica 57: 1091–1120.CrossRefGoogle Scholar
  37. Gallant, A.R., and G. Tauchen. 1996. Which moments to match? Econometric Theory 12: 657–681.CrossRefGoogle Scholar
  38. Geman, S., and C. Hwang. 1982. Nonparametric maximum likelihood estimation by the method of Sieves. Annals of Statistics 10: 401–414.CrossRefGoogle Scholar
  39. Granger, C.W.J., and T. Terasvirta. 1993. Modelling nonlinear economic relationships. New York: Oxford University Press.Google Scholar
  40. Grenander, U. 1981. Abstract inference. New York: Wiley.Google Scholar
  41. Hahn, J. 1998. On the role of the propensity score in efficient semiparametric estimation of average treatment effects. Econometrica 66: 315–332.CrossRefGoogle Scholar
  42. Hall, P., and J. Horowitz. 2005. Nonparametric methods for inference in the presence of instrumental variables. Annals of Statistics 33: 2904–2929.CrossRefGoogle Scholar
  43. Hansen, L.P. 1982. Large sample properties of generalized method of moments estimators. Econometrica 50: 1029–1054.CrossRefGoogle Scholar
  44. Hansen, L.P., and K. Singleton. 1982. Generalized instrumental variables estimation of nonlinear rational expectations models. Econometrica 50: 1269–1286.CrossRefGoogle Scholar
  45. Hausman, J., and W. Newey. 1995. Nonparametric estimation of exact consumer surplus and deadweight loss. Econometrica 63: 1445–1467.CrossRefGoogle Scholar
  46. Heckman, J., and B. Singer. 1984. A method for minimizing the impact of distributional assumptions in econometric models for duration data. Econometrica 68: 839–874.Google Scholar
  47. Hirano, K., G. Imbens, and G. Ridder. 2003. Efficient estimation of average treatment effects using the estimated propensity score. Econometrica 71: 1161–1189.CrossRefGoogle Scholar
  48. Hornik, K., M. Stinchcombe, H. White, and P. Auer. 1994. Degree of approximation results for feedforward networks approximating unknown mappings and their derivatives. Neural Computation 6: 1262–1275.CrossRefGoogle Scholar
  49. Horowitz, J., and S. Lee. 2007. Nonparametric instrumental variables estimation of a quantile regression model. Econometrica 75: 1191–1208.CrossRefGoogle Scholar
  50. Huang, J.Z. 1998. Projection estimation in multiple regression with application to functional ANOVA models. Annals of Statistics 26: 242–272.CrossRefGoogle Scholar
  51. Huang, J.Z. 2003. Local asymptotics for polynomial spline regression. Annals of Statistics 31: 1600–1635.CrossRefGoogle Scholar
  52. Hurvich, C., J. Simonoff, and C. Tsai. 1998. Smoothing parameter selection in nonparametric regression using an improved Akaike information criterion. Journal of the Royal Statistical Society, Series B 60: 271–293.CrossRefGoogle Scholar
  53. Judd, K. 1998. Numerical method in economics. Cambridge, MA: MIT Press.Google Scholar
  54. Koenker, R., P. Ng, and S. Portnoy. 1994. Quantile smoothing splines. Biometrika 81: 673–680.CrossRefGoogle Scholar
  55. Li, K. 1987. Asymptotic optimality for Cp, CL, cross-validation, and generalized cross-validation: Discrete index set. Annals of Statistics 15: 958–975.CrossRefGoogle Scholar
  56. Meyer, Y. 1992. Ondelettes et operateurs I: Ondelettes. Paris: Hermann.Google Scholar
  57. Newey, W.K. 1997. Convergence rates and asymptotic normality for series estimators. Journal of Econometrics 79: 147–168.CrossRefGoogle Scholar
  58. Newey, W.K., and J.L. Powell. 2003. Instrumental variable estimation of nonparametric models. Econometrica 71: 1565–1578.CrossRefGoogle Scholar
  59. Newey, W.K., J.L. Powell, and F. Vella. 1999. Nonparametric estimation of triangular simultaneous equations models. Econometrica 67: 565–603.CrossRefGoogle Scholar
  60. Phillips, P.C.B. 1998. New tools for understanding spurious regressions. Econometrica 66: 1299–1325.CrossRefGoogle Scholar
  61. Robinson, P. 1988. Root-n-consistent semiparametric regression. Econometrica 56: 931–954.CrossRefGoogle Scholar
  62. Schumaker, L. 1981. Spline functions: basic theory. New York: Wiley.Google Scholar
  63. Shen, X. 1997. On methods of sieves and penalization. Annals of Statistics 25: 2555–2591.CrossRefGoogle Scholar
  64. Shen, X., and W. Wong. 1994. Convergence rate of sieve estimates. Annals of Statistics 22: 580–615.CrossRefGoogle Scholar
  65. Shen, X., and J. Ye. 2002. Adaptive model selection. Journal of American Statistical Association 97: 210–221.CrossRefGoogle Scholar
  66. Shintani, M., and O. Linton. 2004. Nonparametric neural network estimation of Lyapunov exponents and a direct test for chaos. Journal of Econometrics 129: 1–33.CrossRefGoogle Scholar
  67. Stone, C.J. 1985. Additive regression and other nonparametric models. Annals of Statistics 13: 689–705.CrossRefGoogle Scholar
  68. Van de Geer, S. 2000. Empirical processes in M-estimation. Cambridge: Cambridge University Press.Google Scholar
  69. Wahba, G. 1990. Spline models for observational data. Philadelphia: CBMS-NSF Regional Conference Series.CrossRefGoogle Scholar
  70. White, H. 1990. Connectionist nonparametric regression: Multilayer feedforward networks can learn arbitrary mappings. Neural Networks 3: 535–550.CrossRefGoogle Scholar
  71. White, H., and J. Wooldridge. 1991. Some results on sieve estimation with dependent observations. In Non-parametric and semi-parametric methods in econometrics and statistics, ed. W.A. Barnett, J. Powell, and G. Tauchen. Cambridge: Cambridge University Press.Google Scholar
  72. Wong, W.H., and X. Shen. 1995. Probability inequalities for likelihood ratios and convergence rates for sieve MLE’s. Annals of Statistics 23: 339–362.CrossRefGoogle Scholar

Copyright information

© Macmillan Publishers Ltd. 2018

Authors and Affiliations

  • Xiaohong Chen
    • 1
  1. 1.