# Large Sample Properties of Estimation in Time Series Observed at Unequally Spaced Times

## Abstract

This paper surveys the current state of large sample theory for estimation in stationary discrete time series observed at unequally spaced times. The paper considers the nonparametric estimation of sample covariances, correlations and spectra and traces the development of consistency and asymptotic normality results for these quantities. The second part of the paper discusses the estimation of finite parameter models for stationary time series. Consistent, but inefficient, methods based on sample covariances and on spectra are discussed and compared. The final part of the paper reports on the recent results concerning a general central limit theorem (for the estimate obtained by a single iteration from a consistent estimate) for Gaussian data. The essential condition on the sampling times is that the finite sample information matrix, when divided by the sample size, has a limit which is non-singular and has finite norm. This condition will be illustrated by considering examples of periodic sampling, of random but time homogeneous sampling, of sparse early sampling, and of asymptotically stationary sampling. The effect on efficiency of the design of sampling pattern will be briefly discussed. Finally it will be indicated what extra complexity of proof is needed to handle the non-Gaussian case.

## Keywords

Central Limit Theorem Asymptotic Normality Asymptotic Variance ARMA Model Stationary Time Series## Preview

Unable to display preview. Download preview PDF.

## References

- Alekseev, V.G, and Savitskii, Yu, A, (1973). “Estimation of the spectrum of a Gaussian Stochastic process on the basis of a realisation of the process with omissions”, Problems of Information Transmission. 91:50–54.Google Scholar
- Bloomfield, P. (1970). “Spectral Analysis with randomly missed observations”, J.R. Statist. Soc. B, 32, 369–380.MathSciNetzbMATHGoogle Scholar
- Bloomfield P. (1973). “An exponential model for the spectrum of a scalar time series”, Biometrika, 60, 217–226.MathSciNetzbMATHCrossRefGoogle Scholar
- Box, G.E.P. and Jenkins, G. (1976). Time series analysis — forecasting and control, 2nd edition, Holden-Day.Google Scholar
- Clinger, W. and Van Ness, J.W. (1976). “On equally spaced time points in time series”, Ann. Statist., 4, 736–745.MathSciNetzbMATHCrossRefGoogle Scholar
- Dunsmuir, W. (1981). “Estimation for stationary time series when data are irregularly spaced or missing”, in: D.F. Findley, ed., Applied Time Series II (Academic Press, New York, 1981).Google Scholar
- Dunsmuir, W. (1983). “A central limit theorem for estimation in Gaussian stationary time series observed at unequally spaced times”, Stochastic Processes and their Applications, 14, 1–17.MathSciNetCrossRefGoogle Scholar
- Dunsmuir, W. and Robinson, P.M. (1981a). “Asymptotic theory for time series containing missing and amplitude modulated observations”, Sankhya, 43, series A, 260–281.MathSciNetzbMATHGoogle Scholar
- Dunsmuir, W. and Robinson, P.M. (1981b). “Parametric estimators for stationary time series with missing observations”, Adv. Appl. Prob., 13, 129–146.MathSciNetzbMATHCrossRefGoogle Scholar
- Dunsmuir, W. and Robinson, P.M. (1981c). “Estimation of time series models in the presence of missing data”, J. Amer. Stat. Assoc., 96, 560–568.Google Scholar
- Hinich, M.J. and Weber, W.E. (1981). “A method for estimating distributed lags when observations are randomly missing”. Pre-print.Google Scholar
- Jones, R.H. (1962). “Spectral analysis with regularly missed observations”, Ann. Math. Statist., 33, 455–461.MathSciNetzbMATHCrossRefGoogle Scholar
- Jones, R.H. (1971). “Spectrum estimation with missing observations”, Ann. Inst. Statist. Math., 23, 387–398.MathSciNetzbMATHCrossRefGoogle Scholar
- Jones, R.H. (1980). “Maximum likelihood fitting of ARMA models to time series with missing observations”, Technometrics, 22, 389–395.MathSciNetzbMATHGoogle Scholar
- Ljung, G.M. (1982). “The likelihood function for a stationary Gaussian autogressive — moving average process with missing observation”, Biometrika, 69, 265–268.MathSciNetCrossRefGoogle Scholar
- Marquardt, D.W. and Acuff, S.K. (1980). “Direct quadratic spectrum estimation for unequally spaced data”, proceedings of the Fifth International Time Series Meeting, Houston.Google Scholar
- Marshall, R.J. (1980). “Autocorrelation estimation of time series with randomly missing observations”, Biometrika, 67, 567–570.MathSciNetzbMATHCrossRefGoogle Scholar
- Neave, H.R. (1970). “Spectral analysis of a stationary time series using initially scarce data”, Biometrika, 57, 111–122.MathSciNetzbMATHCrossRefGoogle Scholar
- Parzen, E. (1962). “Spectral analysis of asymptotically stationary time series”, Bull. I.S.I., 33rd Session, Paris.Google Scholar
- Parzen, E. (1963). “On spectral analysis with missing observations and amplitude modulation”, Sankhya, Ser. A. 25, 383–392.MathSciNetzbMATHGoogle Scholar
- Rice, J. (1979). “On the estimation of the parameters of a power spectrum”, J. Mult. Anal., 9, 378–392.MathSciNetzbMATHCrossRefGoogle Scholar
- Robinson, P.M. (1977). “Estimation of a time series model from unequally spaced data”, Stoch. Proc. Appl., 6, 9–24.zbMATHCrossRefGoogle Scholar
- Robinson, P.M. (1980). “Estimation and forecasting for time series containing censored or missing observations”, Time Series, O.D. Anderson, ed., North-Holland Publishing Company.Google Scholar
- Sakai, H. (1980). “Fitting autoregression with regularly missed observations”, Ann. Inst. Statist. Math, 32, part A, 393–400.MathSciNetzbMATHCrossRefGoogle Scholar
- Sakai, H., Soeda, T. and Tokumaru, H. (1979). “On the relation between fitting autoregression and periodograms with applications”, Ann. Statist., 7, 96–107.MathSciNetzbMATHCrossRefGoogle Scholar
- Sargan, J.D. and Drettakis, E.G. (1974). “Missing data in an autoregressive model”, Int. Econ. Rev., 15, 39–58.MathSciNetzbMATHCrossRefGoogle Scholar
- Scheinok, P.A. (1965). “Spectral analysis with randomly missed observations: the binomial case”, Ann. Math. Statist., 36, 971–977.MathSciNetzbMATHCrossRefGoogle Scholar
- Tan, Suan-Boon. (1979). Maximum likelihood estimation in autoregressive processes with missing data, Ph.D. Thesis, University of Pittsburgh.Google Scholar
- Thrall, A.D. (1980). “A spectral analysis of a time series in which probabilities of observations are periodic”, Time Series, O.D. Anderson, ed., North Holland Publishing Company.Google Scholar