Skip to main content
Log in

On Exponentially Weighted Recursive Least Squares for Estimating Time-Varying Parameters and its Application to Computer Workload Forecasting

  • Published:
Journal of Statistical Theory and Practice Aims and scope Submit manuscript

Abstract

Motivated by a relationship between the exponentially weighted recursive least squares (RLS) and the Kalman filter (KF) under a special state-space model (SSM), several simple generalizations of RLS are discussed. These generalized RLS algorithms preserve the key feature of exponential weighting but provide additional flexibility for better tracking performance. They can even outperform KF in some situations when the SSM assumption does not hold. The algorithms are applied to a problem of computer workload forecasting with real data.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Anderson, A.D.O., Moore, J.B., 1979. Optimal Filtering. Prentice Hall, Englewood Cliffs, NJ.

    MATH  Google Scholar 

  • Bittanti, S., Campi, M., 1994. Bounded error identification of time-varying parameters by RLS techniques. IEEE Trans. Automat. Contr., 39, 1106–1110.

    Article  MathSciNet  Google Scholar 

  • Campi, M., 1994. Exponentially weighted least squares identification of time-varying systems with white disturbances. IEEE Trans. Signal Processing, 42, 2906–2914.

    Article  Google Scholar 

  • Eleftheriou, E., Falconer, D., 1986. Tracking properties and steady-state performance of RLS adaptive filter algorithms. IEEE Trans. Acoust., Speech, Signal Processing, 34, 1097–1110.

    Article  Google Scholar 

  • Eweda, E., 1994. Comparison of RLS, LMS, and sign algorithms for tracking randomly time-varying channels. IEEE Trans. Signal Processing, 42, 2937–2944.

    Article  Google Scholar 

  • Eweda, E., Macchi, O., 1985. Tracking error bounds of adaptive nonstationary filtering. Automatica, 21, 293–302.

    Article  MathSciNet  Google Scholar 

  • Guo, L., Ljung, L., Priouret, P., 1993. Performance analysis of forgetting factor RLS algorithm. Int. J. Adaptive Contr., Signal Processing, 7, 525–537.

    Article  MathSciNet  Google Scholar 

  • Hsia, T.C., 1977. System Identification. Lexington Books, Lexington, MA.

    Google Scholar 

  • Harvey, A.C., 1989. Forecasting, Structural Time Series Models and the Kalman Filter. Cambridge University Press, Cambridge, UK.

    Google Scholar 

  • Haykin, S., 1996. Adaptive Filter Theory, 3rd Edn., Prentice Hall, Upper Saddle River, NJ.

    MATH  Google Scholar 

  • Haykin, S., Sayed, A.H., Zeidler, J.R., Yee, P., Wei, P.C., 1997. Adaptive tracking of linear time-variant systems by extended RLS algorithm. IEEE Trans. Signal Processing, 45, 1118–1128.

    Article  Google Scholar 

  • Jazwinski, A.H., 1970. Stochastic Processes and Filtering Theory. Academic Press, San Diego, CA.

    MATH  Google Scholar 

  • Li, T.H., 2005. A hierarchical framework for modeling and forecasting web server workload. J. Amer. Statist. Assoc., 100, 748–763.

    Article  MathSciNet  Google Scholar 

  • Li, T.H., Hinich, M.J., 2002. A filter bank approach for modeling and forecasting seasonal patterns. Technometrics, 44, 1–14.

    Article  MathSciNet  Google Scholar 

  • Pollock, D.S.G., 2003. Recursive estimation in econometrics. Computational Statistics & Data Analysis, 44, 37–75.

    Article  MathSciNet  Google Scholar 

  • Rao, C.R., 1973. Linear statistical inference and its applications, 2nd Edn. Wiley & Sons, New York.

    Book  Google Scholar 

  • Sayed, A.H., Kailath, T., 1994. A state-space approach to adaptive RLS filtering. IEEE Signal Processing Mag., 11, 11–60.

    Article  Google Scholar 

  • Wei, P.C., Zeidler, J.R., Ku, W.H., 1997. Adaptive recovery of a chirped signal using the RLS algorithm. IEEE Trans. Signal Processing, 45, 363–376.

    Article  Google Scholar 

  • Young, P., 1984. Recursive Estimation and Time Series Analysis. Springer-Verlag, Berlin.

    Book  Google Scholar 

  • Young, P., 2000. Stochastic, dynamic modelling and signal processing: time variable and state dependent parameter estimation. Nonstationary and Nonlinear Signal Processing, pp. 74–114, W.J. Fitzgerald, A. Walden, R. Smith and P. Young, Eds., Cambridge University Press, Cambridge, UK.

    Google Scholar 

  • Zhu, Y., 1999. Efficient recursive state estimator for dynamic systems without knowledge of noise covariances. IEEE Trans. Aerospace and Electronic Systems, 35, 102–114.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ta-Hsin Li.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Li, TH. On Exponentially Weighted Recursive Least Squares for Estimating Time-Varying Parameters and its Application to Computer Workload Forecasting. J Stat Theory Pract 2, 339–354 (2008). https://doi.org/10.1080/15598608.2008.10411879

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1080/15598608.2008.10411879

AMS Subject Classification

Keywords

Navigation