Abstract
Stochastic processes have applications in many areas such as oceanography and engineering. Special classes of such processes deal with time series of sparse data. Studies in such cases focus in the analysis, construction and prediction in parametric models. Here, we assume several non-linear time series with additive noise components, and the model fitting is proposed in two stages. The first stage identifies the density using all the clusters information, without specifying any prior knowledge of the underlying distribution function of the time series. In the second stage, we partition the time series into consecutive non-overlapping intervals of quasi stationary increments where the coefficients shift from one stable regression relationship to a different one using breakpoint detection algorithm. These breakpoints are estimated by minimizing the likelihood from the residuals. We approach time series prediction through the mixture distribution of combined error components. Parameter estimation of mixture distribution is done by using the EM algorithm. We apply the method to a simulated data.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Andreou, E., & Ghysels, E. (2002). Detecting multiple breaks in financial market volatility dynamics. Journal of Applied Econometric, 17, 579-600.
Brockwell, P.J., & Davis, R.A. (1991). Time Series: Theory and Methods, 2nd Ed., New York: Springer.
Brockwell, P.J., & Davis, R.A. (2002). Introduction to Time Series and Forecasting, 2nd Ed., New York: Springer-Verlag.
Casella, G., & Berger, R.L. (2002). Statistical Inference, 2nd Ed., Pacific Grove: Duxbury.
Craigmile, P.F., & Titterington, D.M. (1997) Parameter estimation for finite mixtures of uniform distributions. Communications in Statistics: Theory and Methods, 26(8), pp. 1981–1995.
Gupta, A.K., & Miyawaki, T. (1978). On a uniform mixture model. Biometrical Journal, 20, 631–637.
Henning, E. (2004). Finding Your Way in Qualitative Research. Pretoria: Van Schaik Publishers.
Pesaran, M.H.,, Pettenuzzo, D., & Timmermann, A. (2006). Forecasting time series subject to multiple structural breaks. Review of Economic Studies, 73, 1057–1084.
Stock, J.H. (2008). Introduction to Econometrics, Pearson Education.
Teicher, H. (1963). Identifiability of Finite Mixtures, The Annals of Mathematical Statistics, 34, 1265–1269
Bai, J. (1994). Least squares estimation of a shift in linear processes. Journal of Time Series Analysis, 15, 453–472.
Bai, J. (1997a). Estimating multiple breaks one at a time. Econometric Theory, 13, 315–352.
Bai, J. (1997b). Estimation of a change point in multiple regression models. Review of Economics and Statistics, 79, 551–563.
Bai, J., & Perron, P. (1998). Estimating and testing linear models with multiple structural changes. Econometrica, 66, 47–78.
Bai, J., & Perron, P. (2003). Computation and analysis of multiple structural change models. Journal of Applied Econometrics, 18, 1–22.
Bellman, R. (1952). On the theory of dynamic programming. Proceedings of the National Academy of Sciences, 1952.
Cappè, O., Moulines, E., & Rydèn, T. (2005). Inference in hidden markov models. New York: Springer.
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, B, 39, 1–38.
Durbin, J., & Koopman, S. J. (2001). Time series analysis by state space methods. Oxford: Oxford University Press.
Fokianos, K., Kedem, B., Qin, J., & Short, D. A. (2001). A semiparametric approach to the one-way layout. Technometrics, 43, 56–65.
Garcia, R., & Perron, P. (1996). An analysis of the real interest rate under regime shifts. Review of Economics and Statistics, 78, 111–125.
Gilbert, P. B. (2000). Large sample theory of maximum likelihood estimation in semiparametric biased sampling models. Annals of Statistics, 28, 151–194.
Kedem, B., & Gagnon, R. (2010). Semiparametric distribution forecasting. Journal of Statistical Planning and Inference, 140, 3734–3741.
Koop, G., & Potter, S. (2001). Are apparent findings of nonlinearity due to structural instability in economic time series? Econometric Journal, 4, 37–55.
Pastor, L., & Stambaugh, R. F. (2001). The equity premium and structural breaks. Journal of Finance, 56, 1207–1239.
Patton, A., Politis D. N., & White H. (2009). CORRECTION TO “Automatic block-length selection for the dependent bootstrap by D. Politis and H. White”. Econometric Reviews 28(4), 372–375.
Politis, D. N., & Romano, J. P. (1994). The stationary bootstrap. Journal of American Statistical Association, 89, 1303–1313.
Qin, J. (1993). Empirical likelihood in biased sampling problems. Annals of Statistics, 21, 1182–1186.
Qin, J., & Lawless, J. F. (1994). Empirical likelihood and general estimating equations. Annals of Statistics, 22, 300–325.
Qin, J., & Zhang, B. (1997). A goodness of fit test for logistic regression models based on case-control data. Biometrica, 84, 609–618.
West, M., & Harrison, J. (1997). Bayesian forecasting and dynamic models (2nd Ed.). New York: Springer.
Zeileis, A., Leisch, F., Hornik, K., & Kleiber, C. (2003). Strucchange: An R package for testing for structural change in linear regression models. Journal of Statistical Software, 7(2), 1–38.
Zhang, B. (2000). M-estimation under a two sample semiparametric model. Scandinavian Journal of Statistics, 27, 263–280.
Acknowledgements
The authors would like to express sincere thanks to the late Professor Dayanand Naik for his insightful comments and suggestions during the research which resulted in an improvement in the presentation of this work. We dedicate this work to him.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Lamichhane, R., Diawara, N., Jones, C.M. (2014). Forecasting of Time Series Data Using Multiple Break Points and Mixture Distributions. In: Toni, B. (eds) New Frontiers of Multidisciplinary Research in STEAM-H (Science, Technology, Engineering, Agriculture, Mathematics, and Health). Springer Proceedings in Mathematics & Statistics, vol 90. Springer, Cham. https://doi.org/10.1007/978-3-319-07755-0_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-07755-0_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07754-3
Online ISBN: 978-3-319-07755-0
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)