Prediction of High-Dimensional Time Series with Exogenous Variables Using Generalized Koopman Operator Framework in Reproducing Kernel Hilbert Space
- 1.1k Downloads
We propose a novel methodology to predict high-dimensional time series with exogenous variables using Koopman operator framework, by assuming that the time series are generated by some underlying unknown dynamical system with input as exogenous variables. In order to do that, we first generalize the definition of the original Koopman operator to allow for input to the underlying dynamical system. We then obtain a formulation of the generalized Koopman operator in reproducing kernel Hilbert space (RKHS) and a new derivation of its numerical approximation methods, namely, Extended Dynamic Mode Decomposition (EDMD) and its kernel-based version. We also obtain a statistical interpretation of kernel-based EDMD developed for deterministic Koopman operator by utilizing the connection between RKHS and Gaussian processes regression, and relate it to the stochastic Koopman and Perron–Frobenius operator. In applications, we found that the prediction performance of this methodology is promising in forecasting real-world high-dimensional time series with exogenous variables, including financial markets data. We believe that this methodology will be of interest to the community of scientists and engineers working on quantitative finance, econometrics, system biology, neurosciences, meteorology, oceanography, system identification and control, data mining, machine learning, computational intelligence, and many other fields involving high-dimensional time series and spatiotemporal data.
KeywordsHigh-dimensional time series Spatiotemporal dynamics Complex system Koopman operator Perron–Frobenius operator Dynamical system Reproducing kernel Hilbert space Gaussian processes Machine learning Data mining Econophysics Financial markets modeling Energy forecasting Collective behavior
The corresponding author would like to thank Dr. Alexandre Mauroy for insightful discussions on generalizing Koopman operator to systems with input.
- 1.Koopman, B.O.: PNAS 17(5), 315 (1931)Google Scholar
- 7.Proctor, J.L., Brunton, S.L., Kutz, J.N.: arXiv:1602.07647 [math] (2016)
- 8.Williams, M.O., Rowley, C.W., Kevrekidis, I.G.: arXiv:1411.2260 [math] (2014)
- 11.Rasmussen, C.E., Williams, C.K.I.: Adaptive computation and machine learning. In: Gaussian Processes for Machine Learning. MIT Press, Cambridge, MA (2006)Google Scholar
- 14.Cvitanović, P., Artuso, R., Mainieri, R., Tanner, G., Vattay, G.: Chaos: Classical and Quantum. Niels Bohr Inst., Copenhagen (2016)Google Scholar
- 16.Klus, S., Nüske, F., Koltai, P., Wu, H., Kevrekidis, I., Schütte, C., Noé, F.: arXiv:1703.10112 [math] (2017)