Advertisement

Semiparametric Approaches to Dimension Reduction

  • Wolfgang K. Härdle
  • Berwin A. Turlach
Conference paper

Abstract

We give an overview on several semiparametric methods utilised to model high-dimensional data. Our approach is semiparametric in nature and is related to Generalised Linear Models. We focus on dynamic estimation techniques in this setting. In particular we discuss Generalized Additive Models (GAM), Alternating Conditional Expectations (ACE), Average Derivative Estimation (ADE), semiparametric weighted least squares (Single Index Models, SIM), Projection Pursuit Regression (PPR) , and Sliced Inverse Regression (SIR). Their performance in practice and theory is compared.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bierens, H.J. (1990), “A consistent conditional moment test of functional form,” Econometrica, 58, 1443–1458.CrossRefGoogle Scholar
  2. Breiman, L. and Friedman, J.H. (1985), “Estimating optimal transformations for multiple regression and correlation (with discussion),” Journal of the American Statistical Association, 80, 580–619.CrossRefGoogle Scholar
  3. Buja, A., Hastie, T.J. and Tibshirani, R.J. (1989), “Linear smoothers and additive models (with discussion),” The Annals of Statistics, 17, 453–555.CrossRefGoogle Scholar
  4. Eubank, R.L. (1988), Smoothing Splines and Nonparametric Regression, Marcel Dekker, New York and Basel.Google Scholar
  5. Friedman, J.H. and Stuetzle, W. (1981), “Projection Pursuit Regression,” Journal of the American Statistical Association, 76, 817–823.CrossRefGoogle Scholar
  6. Härdle, W. (1990), Applied Non-parametric Regression, Econometric SOCiety Monograps No. 19, Cambridge University Press.Google Scholar
  7. Härdle, W., Hall, P. and Ichimura, H. (1992), “Optimal Smoothing in Single Index Models,” The Annals of Statistics, to appear.Google Scholar
  8. Härdle, W., Hart J., Marron J.S., and Tsybakov, A.B. (1992), “Bandwidth Choice for Average Derivative Estimation,” Journal of the American Statistical Association, 87, 218–226.Google Scholar
  9. Härdle, W. and Stoker, T.M. (1989), “Investigating Smooth Multiple Regression by the Method of Average Derivatives,” Journal of the American Statistical Association, 84, 986–995.Google Scholar
  10. Hall, P. (1989), “On Projection Pursuit Regression,” The Annals of Statistics, 17, 573–588CrossRefGoogle Scholar
  11. Hastie, T.J. and Tibshirani, R.J. (1987), “Non-parametric Logistic and Proportional Odds Regression,” Applied Statistics, 36, 260–276.CrossRefGoogle Scholar
  12. Hastie, T.J. and Tibshirani, R.J. (1990), Generalized Additive Models, Chapman and Hall, London.Google Scholar
  13. Horowitz, J. and Härdle, W. (1992), “Testing a parametric model against a semiparametric alternative,” CentER Discussion Paper.Google Scholar
  14. Huber, P.J. (1985), “Projection Pursuit,” The Annals of Statistics, 13, 435–475.CrossRefGoogle Scholar
  15. Ichimura, H. (1993), “Semi parametric Least Squares (SLS) and Weighted SLS Estimation of SingleIndex Models,” Journal of Econometrics, special issue on “Non parametric Approaches to Discrete Choice Models”, ed. W. Härdle and C.P. Manski.Google Scholar
  16. Li, KC. (1991a) “Sliced Inverse Regression for Dimension Reduction (with discussion),” Journal of the American Statistical Association, 86, 316–342.CrossRefGoogle Scholar
  17. Li, KC. (1991b), Notes from the course MATH277-DATA ANALYSIS-Winter 1991, University of California, Los Angeles.Google Scholar
  18. Müller, H.G. (1988), Nonparametric Regression Analysis of Longitudinal Data, Lecture Notes in Statistics 46, Springer, New York.Google Scholar
  19. Newey, W.K (1985), “Maximum likelihood specification testing and conditional moment test,” Econometrica, 53, 1047–1070.CrossRefGoogle Scholar
  20. McCullagh, P. and Nelder, J.A. (1989), Generalized Linear Models, 2nd Edition, Chapman and Hall, London.CrossRefGoogle Scholar
  21. Proença, I.M. (1992), On the performance of a test against a semiparametric alternative, manuscript in preparation.Google Scholar
  22. Rodrìguez-Campos, M.C. and Cao-Abad, R. (1993), “Nonparametric Bootstrap Confidence Intervals for Discrete Regression Functions,” Journal of Econometrics, special issue on “Nonparametric Approaches to Discrete Choice Models”, ed. W. Härdle and C.F. Manski.Google Scholar
  23. Silverman, B.W. (1986), Density Estimation for Statistical and Data Analysis, Chapman and Hall, London.CrossRefGoogle Scholar
  24. Stoker, T.M. (1991), “Equivalence of Direct, Indirect and Slope Estimators of Average Derivatives,” in Nonparametric and Semiparametric Methods in Econometrics and Statistics, Barnett, W.A., J.L. Powell and G. Tauchen, eds., Cambridge University Press.Google Scholar
  25. Stoker, T.M. (1992), Lectures on Semiparametrics Econometrics, CORE Lecture Series, Louvainla-Neuve.Google Scholar
  26. Stoker, T.M. and Villas-Boas, J.M. (1992), “Monte Carlo Simulation of Average Derivative Estimators,” Discussion Paper, Sloan School of Management, MIT.Google Scholar
  27. Tibshirani, R.J. (1988), “Estimating optimal transformations for regression via additivity and variance stabilization,” Journal of the American Statistical Association, 83, 394–405.CrossRefGoogle Scholar
  28. Turlach, B. (1992), “On Discretization Methods for Average Derivative Estimation,” CORE Discussion Paper No 9232.Google Scholar
  29. Wahba, G. (1990), Spline FUnctions for Observational Data, CBMS-NSF Regional Conference series, SIAM, Philadelphia.Google Scholar
  30. XploRe (1992), XploRe 3.0 — a computing environment for eXploratory Regression and data analysis. Available from XploRe Systems, C.O.R.E., Universite Catholique de Louvain, Belgium.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1993

Authors and Affiliations

  • Wolfgang K. Härdle
    • 1
  • Berwin A. Turlach
    • 2
  1. 1.FB WirtschaftswissenschaftenHumboldt Universität zu BerlinBerlinGermany
  2. 2.C.O.R.E. and Institut de StatistiqueUniversitè Catholique de LouvainLouvain-la-NeuveBelgium

Personalised recommendations