Abstract
The integer autoregressive model of order p can be employed for the analysis of discrete–valued time series data. It can be shown, under some conditions, that its correlation structure is identical to that of the usual autoregressive process. The model is usually fitted by the method of least squares. However, consider an alternative estimation scheme, which is based on minimizing the least squares criterion subject to some constraints on the parameters of interest. The ridge type of constraints are used in this article and it is shown that under some reasonable conditions on the penalty parameter, the resulting estimates have lessmean square error than that of the ordinary least squares. A real data set and some limited simulations support further the results.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Akaike, H. (1974). A new look at the statistical model identification, IEEE Transactions on Automatic Control AC–19: 716–723.
Al-Osh,M.A.&Alzaid, A. A. (1987). First-order integer-valued autoregressive (INAR(1)) process, Journal of Time Series Analysis 8: 261–275.
Alzaid, A. A.&Al-Osh,M. (1990). An integer-valued pth-order autoregressive structure (INAR(p)) process, Journal of Applied Probability 27: 314–324.
Brockwell, P. J. & Davis, R. A. (1991). Time Series: Data Analysis and Theory, 2nd edn, Springer, New York.
Du, J. G.&Li,Y. (1991). The integer-valued autoregressive INAR(p) model, Journal of Time Series Analysis 12: 129–142.
Fahrmeir, L. & Kaufmann, H. (1985). Consistency and asymptotic Normality of the maximum likelihood estimates in generalized linear models, Annals of Statistics 13: 342–368.
Fahrmeir, L. & Kaufmann, H. (1987). Regression Models for Nonstationary Categorical Time Series, Journal of Time Series Analysis 8: 147–160.
Fahrmeir, L. & Tutz, G. (2001). Multivariate Statistical Modelling Based on Generalized Linear Models, 2nd edn, Springer, New York.
Ferland, R., Latour, A. & Oraichi, D. (2006). Integer–valued GARCH processes, Journal of Time Series Analysis Analysis 27: 923–942.
Frank, I. E. & Friedman, J. H. (1993). A statistical view of some chemometrics regression tools, Technometrics 35: 109–148. (with discussion).
Grunwald, G. K., Hyndman, R. J., Tedesco, L. & Tweedie, R. L. (2000). Non-Gaussian conditional linear AR(1) models, Australian & New Zealand Journal of Statistics 42: 479–495.
Guttorp, P. (1991). Statistical Inference for Branching Processes, Wiley, New York.
Hall, P. & Heyde, C. C. (1980). Martingale Limit Theory and its Applications, Academic Press, New York.
Hoerl, A. E.&Kennard, R.W. (1970a). Ridge regression:Applications to non–orthogonal problems, Technometrics 12: 69–82.
Hoerl, A. E. & Kennard, R. W. (1970b). Ridge regression:Biased estimation for non–orthogonal problems, Technometrics 12: 55–67.
Jung, R. C. & Tremayne, A. R. (2006). Coherent forecasting in integer time series models, International Journal of Forecasting 22: 223–238.
Kedem, B. & Fokianos, K. (2002). Regression Models for Time Series Analysis, Wiley, Hoboken, NJ.
Klimko, L. A. & Nelson, P. I. (1978). On conditional least squares estimation for stochastic processes, The Annals of Statistics 6: 629–642.
Knight, K. & Fu,W. (2000). Asymptotics for lasso–type estimators, Annals of Statistics 28: 1356– 1378.
Latour,A. (1998). Existence and stochastic structure of a non-negative integer-valued autoregressive process, Journal of Time Series Analysis 19: 439–455.
McKenzie, E. (1985). Some simplemodels for discrete variate time series,Water Resources Bulletin 21: 645–650.
McKenzie, E. (1986). Autoregressive moving-average processes with negative-binomial and geometric marginal distributions, Advances in Applied Probability 18: 679–705.
McKenzie, E. (1988). Some ARMA models for dependent sequences of Poisson counts, Advances in Applied Probability 20: 822–835.
Neal, P. & Subba Rao, T. (2007). MCMC for integer–valued ARMA processes, Journal of Time Series Analysis 28: 92–100.
Taniguchi, M. & Hirukawa, J. (2005). The Stein-James estimator for short- and long-memory Gaussian processes, Biometrika 92: 737–746.
Tibshirani, R. (1996). Regression shrinkage and selection via the lasso, Journal of the Royal Statistical Society, Series B 58: 267–288.
Zheng, H., Basawa, I. V.&Datta, S. (2006). Inference for the pth–order random coefficient integer– valued process, Journal of Time Series Analysis 27: 411–440.
Zhu, R. & Joe, H. (2006). Modelling count data time series with Markov processes based on binomial thinning, Journal of Time Series Analysis 27: 725–738.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Fokianos, K. (2010). Penalized Estimation for Integer Autoregressive Models. In: Kneib, T., Tutz, G. (eds) Statistical Modelling and Regression Structures. Physica-Verlag HD. https://doi.org/10.1007/978-3-7908-2413-1_18
Download citation
DOI: https://doi.org/10.1007/978-3-7908-2413-1_18
Published:
Publisher Name: Physica-Verlag HD
Print ISBN: 978-3-7908-2412-4
Online ISBN: 978-3-7908-2413-1
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)