Skip to main content
Log in

Robust second-order least-squares estimation for regression models with autoregressive errors

  • Regular Article
  • Published:
Statistical Papers Aims and scope Submit manuscript

Abstract

Rosadi and Peiris (Comput Stat 29:931–943, 2014) applied the second-order least squares estimator (SLS), which was proposed in Wang and Leblanc (Ann Inst of Stat Math 60:883–900, 2008), to regression models with autoregressive errors. In case of autocorrelated errors, it shows that the SLS performs well for estimating the parameters of the model and gives small bias. For less correlated data, the standard error (SE) of the SLS lies between the SE of the ordinary least squares estimator (OLS) and the generalized least squares estimator, however, for more correlated data, the SLS has higher SE than the OLS estimator. In case of a regression model with iid errors, Chen, Tsao and Zhou (Stat Pap 53:371–386, 2012) proposed a method to improve the robustness of the SLS against X-outliers. In this paper, we consider a new robust second-order least squares estimator (RSLS), which extends the study in Chen et al. (2012) to the case of regression with autoregressive errors, and the data may be contaminated with all types of outliers (X-, y-, and innovation outliers). Besides the regression coefficients, here we also propose a robust method to estimate the parameters of the autoregressive errors and the variance of the errors. We evaluate the performance of the RSLS by means of simulation studies. In the simulation study, we consider both a linear and a nonlinear regression model. The results show that the RSLS performs very well. We also provide guidelines to use the RSLS in practice and present a real example.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Chen X, Tsao M, Zhou J (2012) Robust second-order least-squares estimator for regression models. Stat Pap 53(2):371–386

    Article  MathSciNet  MATH  Google Scholar 

  • Filzmoser P, Maronna R, Werner M (2008) Outlier identification in high dimensions. Comput Stat Data Anal 52:1694–1711

    Article  MathSciNet  MATH  Google Scholar 

  • Gujarati D (2003) Basic econometrics, 4th edn. McGraw-Hill, Singapore

    Google Scholar 

  • Maronna A, Martin RD, Yohai VJ (2006) Robust statistics: theory and methods. Wiley, Chicester

    Book  MATH  Google Scholar 

  • Prais SJ, Winsten CB (1954) Trend estimators and serial correlation. Cowless commission discussion paper, statistics no. 383

  • R Core Team (2016) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna. http://www.R-project.org/

  • Rocke D (1996) Robustness properties of S-estimators of multivariate location and shape in high dimension. Ann Stat 24(3):1327–1345

    Article  MathSciNet  MATH  Google Scholar 

  • Rosadi D, Peiris S (2014) Second-order least-squares estimation for regression with autocorrelated error. Comput Stat 29:931–943

    Article  MATH  Google Scholar 

  • Rousseeuw PJ, Leroy AM (1987) Robust regression and outlier detection. Wiley, New York

    Book  MATH  Google Scholar 

  • Rousseeuw PJ, van Driessen K (1999) A fast algorithm for the minimum covariance determinant estimator. Technometrics 41:212–223

    Article  Google Scholar 

  • Wang L, Leblanc A (2008) Second-order nonlinear least squares estimation. Ann Inst Stat Math 60:883–900

    Article  MathSciNet  MATH  Google Scholar 

  • Yohai VJ (1987) High breakdown-point and high efficiency robust estimates for regression. Ann Stat 15:642–656

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgments

The financial support for D. Rosadi from OeAD - ASEA-UNINET to initiate this project and Hibah KLN - DIKTI 2016 to revise and to finish the report is also gratefully acknowledged. This work has been done while D. Rosadi was visiting Department of Statistics and Probability Theory, Vienna University of Technology, Austria. The authors would like to thank the anonymous referee and the editor of this journal for their constructive comments and useful suggestions to improve the quality and readability of this manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to D. Rosadi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rosadi, D., Filzmoser, P. Robust second-order least-squares estimation for regression models with autoregressive errors. Stat Papers 60, 105–122 (2019). https://doi.org/10.1007/s00362-016-0829-9

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00362-016-0829-9

Keywords

Mathematics Subject Classification

Navigation