Mining Multivariate Time Series Models with Soft-Computing Techniques: A Coarse-Grained Parallel Computing Approach
This paper presents experimental results of a parallel implementation of a soft-computing algorithm for model discovery in multivariate time series, possibly with missing values. It uses a hybrid neural network with two different types of neurons trained with a nontraditional procedure. Models describing the multivariate time dependencies are encoded as binary strings representing neural networks, and evolved using genetic algorithms. The present paper studies its properties from an experimental point of view (using homogeneous and heterogeneous clusters) focussing on: i) the influence of missing values, ii) the factors controlling the parallel computation, and iii) the effectiveness of the time series prediction results. Results confirm that i) the algorithm possesses high tolerance to missing data, ii) Athon-based homogeneous clusters have higher throughput than Xeon-based homogeneous clusters, iii) an increase of the number of slaves reduces the processing time until communication overhead dominates (as expected), and iv) running the algorithm in parallel does not affect the RMS error (as expected). Even though much of this behavior could be qualitatively expected, appropriate tradeoffs between error and time were actually discovered, thereby enabling more effective, systematic, future uses of the system.
KeywordsGenetic Algorithm Hide Layer Parallel Implementation Multivariate Time Series Heterogeneous Cluster
Unable to display preview. Download preview PDF.
- [B00]Belanche, Ll.: Heterogeneous neural networks: Theory and applications. PhD Thesis, Department of Languages and Informatic Systems, Polytechnic University of Catalonia, Barcelona, Spain, July,(2000).Google Scholar
- [M95]Masters, T.: Neural, Novel & Hybrid Algorithms for Time Series Prediction. John Wiley & Sons, (1995).Google Scholar
- [MPI]Pacheco, P.: Parallel Programming with MPI. Morgan Kaufmann, (1997).Google Scholar
- [VG97]Valdés, J.J. García, R.: A model for heterogeneous neurons and its use in configuring neural networks for classification problems. Proc. IWANN’97, Int. Conf. On Artificial and Natural Neural Networks. Lecture Notes in Computer Science 1240, Springer Verlag, (1997), pp.237–246.Google Scholar
- [V02]Valdés, J.J.: Similarity-based Neuro-Fuzzy Networks and Genetic Algorithms in Time Series Models Discovery. NRC/ERB-1093, 9 pp. NRC 44919.(2002).Google Scholar
- [VM02]Valdés, J.J., Mateescu, G.: Time Series Model Mining with Similarity-Based Neuro-Fuzzy Networks and Genetic Algorithms: A Parallel Implementation. Third. Int. Conf. on Rough Sets and Current Trends in Computing RSCTC 2002. Malvern, PA, USA, Oct 14–17. Alpigini, Peters, Skowron, Zhong (Eds.) Lecture Notes in Computer Science (Lecture Notes in Artificial Intelligence Series) LNCS 2475, pp. 279–288. Springer-Verlag, 2002.CrossRefGoogle Scholar
- [V02a]Valdés, J.J.: Similarity-based heterogeneous neurons in the context of general observational models. Neural Network World, 12(5), (2002), 499–508.Google Scholar
- [WM96]Wall, T.: GaLib: A C++ Library of Genetic Algorithm Components. Mechanical Engineering Dept. MIT (http://lancet.mit.edu/ga/), (1996).