Skip to main content

Smoothing: Local Regression Techniques

  • Chapter
  • First Online:
Handbook of Computational Statistics

Part of the book series: Springer Handbooks of Computational Statistics ((SHCS))

Abstract

Smoothing methods attempt to find functional relationships between different measurements. As in the standard regression setting, the data is assumed to consist of measurements of a response variable, and one or more predictor variables. Standard regression techniques (Chap. III8.) specify a functional form (such as a straight line) to describe the relation between the predictor and response variables. Smoothing methods take a more flexible approach, allowing the data points themselves to determine the form of the fitted curve.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Akaike, H.: Information theory and an extension of the maximum likelihood principle. In: Petrov, B.N., Csàki, F. (eds.) Second International Symposium on Information Theory, pp. 267–281. Budapest, Akademia Kiadó (1972)

    Google Scholar 

  • Akaike, H.: A new look at the statistical model identification. IEEE Trans. Automat. Contr. 19, 716–723 (1974)

    Article  MathSciNet  MATH  Google Scholar 

  • Azzalini, A., Bowman, A.W.: Applied Smoothing Techniques for Data Analysis. Oxford University Press, Oxford (1997)

    MATH  Google Scholar 

  • Cleveland, W.S.: Robust locally weighted regression and smoothing scatterplots. J. Am. Stat. Assoc. 74, 829–836 (1979)

    Article  MathSciNet  MATH  Google Scholar 

  • Cleveland, W.S., Devlin, S.J.: Locally weighted regression: An approach to regression analysis by local fitting. J. Am. Stat. Assoc. 83, 596–610 (1988)

    Article  MATH  Google Scholar 

  • Efromovich, S.: Nonparametric Curve Estimation. Springer, New York (1999)

    MATH  Google Scholar 

  • Fan, J., Gijbels, I.: Data-driven bandwidth selection in local polynomial fitting: variable bandwidth and spatial adaptation. J. Roy. Stat. Soc. B 57, 371–394 (1995)

    MathSciNet  MATH  Google Scholar 

  • Fan, J., Gijbels, I.: Local Polynomial Modelling and its Applications. Chapman and Hall, London (1996)

    MATH  Google Scholar 

  • Friedman, J., Stuetzle, W.: Projection pursuit regression. J. Am. Stat. Assoc. 76, 817–823 (1981)

    Article  MathSciNet  Google Scholar 

  • Green, P.J., Silverman, B.: Nonparametric regression and Generalized Linear Models: A Roughness Penalty Approach. Chapman and Hall, London (1994)

    MATH  Google Scholar 

  • Härdle, W.: Applied Nonparametric Regression. Cambridge University Press, Cambridge (1990)

    MATH  Google Scholar 

  • Hart, J.D.: Nonparametric Smoothing and Lack-of-Fit Tests. Springer, New York (1997)

    MATH  Google Scholar 

  • Hastie, T.J., Loader, C.R.: Local regression: Automatic kernel carpentry (with discussion). Stat. Sci. 8, 120–143 (1993)

    Article  Google Scholar 

  • Hastie, T.J., Tibshirani, R.J.: Generalized Additive Models. Chapman and Hall, London (1990)

    MATH  Google Scholar 

  • Henderson, R.: Note on graduation by adjusted average. Trans. Actuarial Soc. Am. 17, 43–48 (1916)

    Google Scholar 

  • Henderson, R.: A new method of graduation. Trans. Actuarial Soc. Am. 25, 29–40 (1924)

    Google Scholar 

  • Hjort, N.L., Jones, M.C.: Locally parametric nonparametric density estimation. Ann. Stat. 24, 1619–1647 (1996)

    Article  MathSciNet  MATH  Google Scholar 

  • Katkovnik, V.Y.: Linear and nonlinear methods of nonparametric regression analysis. Soviet Autom. Contr. 5, 35–46 (25–34) (1979)

    Google Scholar 

  • Loader, C.: Local likelihood density estimation. Ann. Stat. 24, 1602–1618 (1996)

    MathSciNet  MATH  Google Scholar 

  • Loader, C.: Bandwidth selection: Classical or plug-in? Ann. Stat. 27, 415–438 (1999a)

    Article  MathSciNet  MATH  Google Scholar 

  • Loader, C.: Local Regression and Likelihood. Springer, New York (1999b)

    MATH  Google Scholar 

  • Mallows, C.L.: Some comments on \({c}_{p}\). Technometrics 15, 661–675 (1973)

    MATH  Google Scholar 

  • Nadaraya, E.A.: On estimating regression. Theor. Probab. Appl. 9, 157–159 (141–142) (1964)

    Google Scholar 

  • Ruppert, D., Sheather, S.J., and Wand, M.P.: An effective bandwidth selector for local least squares regression. J. Am. Stat. Assoc. 90, 1257–1270 (1995)

    Article  MathSciNet  MATH  Google Scholar 

  • Ruppert, D., Wand, M.P.: Multivariate locally weighted least squares regression. Ann. Stat.22, 1346–1370 (1994)

    Article  MathSciNet  MATH  Google Scholar 

  • Ruppert, D., Wand, M.P., Carroll, R.J.: Semiparametric Regression. Cambridge University Press, Cambridge (2003)

    Book  MATH  Google Scholar 

  • Schiaparelli, G.V.: Sul modo di ricavare la vera espressione delle leggi delta natura dalle curve empiricae. Effemeridi Astronomiche di Milano per l’Arno 857, 3–56 (1866)

    Google Scholar 

  • Silverman, B.W.: Some aspects of the spline smoothing approach to nonparametric regression curve fitting (with discussion). J. Roy. Stat. Soc. B 47, 1–52 (1985)

    MATH  Google Scholar 

  • Stone, C.J.: Consistent nonparametric regression (with discussion). Ann. Stat. 5, 595–645 (1977)

    Article  MATH  Google Scholar 

  • Tibshirani, R.J., Hastie, T.J.: Local likelihood estimation. J. Am. Stat. Assoc. 82, 559–567 (1987)

    Article  MathSciNet  MATH  Google Scholar 

  • Wahba, G.: Spline Models for Observational Data, SIAM, Philadelphia (1990)

    Book  MATH  Google Scholar 

  • Wahba, G., Wold, S.: A completely automatic French curve: Fitting spline functions by cross-validation. Comm. Stat. 4, 1–17 (1975)

    Article  MathSciNet  MATH  Google Scholar 

  • Watson, G.S.: Smooth regression analysis. Sankhya A 26, 359–372 (1964)

    MATH  Google Scholar 

  • Whitaker, E.T.: On a new method of graduation. Proc. Edinb. Math. Soc. 41, 62–75 (1923)

    Google Scholar 

Download references

Acknowledgements

This work was supported by National Science Foundation Grant DMS 0306202.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Catherine Loader .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Loader, C. (2012). Smoothing: Local Regression Techniques. In: Gentle, J., Härdle, W., Mori, Y. (eds) Handbook of Computational Statistics. Springer Handbooks of Computational Statistics. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21551-3_20

Download citation

Publish with us

Policies and ethics