A Neural Network Based Methodology for Performance Evaluation of Parallel Systems
In this study we propose a method using multi layer perceptron (MLP) neural networks to evaluate and predict the performance of parallel systems and report our findings. Artificial neural networks may provide a good alternative to conventional methods in terms of identifying the contribution of individual system and application parameters to performance. Neural network models presented here are used to predict the computational and communication performance of parallel applications running on different platforms. Two applications are considered: the first one is a 2-Dimensional Fast Fourier Transform (FFT) application that requires intensive data exchange between processors, which is valuable for communication performance tests and the second one is a Monte Carlo application which can be classified as a typical floating-point application. There are two types of data used to train, validate and test the neural network models. A large portion of the input data composed from real measurements taken on SunSparc workstations. To enhance the available data, results obtained by modeling some unavailable systems into PACE (the Performance Analysis and Characterization Environment) have been also included.
KeywordsNeural Network Fast Fourier Transform Neural Network Model Multi Layer Perceptron Application Parameter
Unable to display preview. Download preview PDF.
- 1.Yuan, C., Niemann, H.: An appearance based neural image processing algorithm for 3-D object recognition. In: Proceedings of International Conference on Image Processing, vol. 3, pp. 344–347 (2000)Google Scholar
- 2.Dongarra, J.J., Martin, J., Worlton, J.: Computer Benchmarking Paths And Pitfalls. IEEE Computer 24, 38–43 (1987)Google Scholar
- 3.Gropp, W., Lusk, E., Skjellum, A.: Using MPI: Portable Parallel Programming with the Message Passing Interface, 2nd edn. Scientific and Engineering Computation Series. The MIT Press, Cambridge (1999)Google Scholar
- 5.Han, J., Kamber, M.: Data mining concepts and techniques. Academic Press, San Francisco (2001)Google Scholar
- 6.Jackel, P.: Monte Carlo Methods in Finance. John Wiley & Sons Ltd., England (2002)Google Scholar
- 7.Jain, R.: The Art of Computer Systems Performance Analysis - Techniques for Experimental Design, Measurement, Simulation and Modelling. John Wiley & Sons Ltd., Chichester (1991)Google Scholar
- 8.Jain Anil, K., Mao, J., Mohiuddin, K.M.: Artificial Neural Networks: A Tutorial. IEEE Computer 29(3), 31–44 (1996)Google Scholar
- 9.John, L.K.: More on finding a single number to indicate overall performance of a benchmark suite. ACM SIGARCH Computer Architecture News 32(1) (March 2004)Google Scholar
- 12.Neji, Z., Beji, F.M.: Neural Network and Time Series Identification and Prediction. In: IEEE INNS-ENNS International Joint Conference on Neural Networks (IJCNN 2000), Italy, vol. 4 (2000)Google Scholar
- 13.Nudd, G.R., Kerbyson, D.J., Papaefstathiou, E., Harper, J.S., Perry, S.C., Wilcox, D.V.: PACE: A toolset for the performance prediction of parallel and distributed systems. Journal of High Performance and Scientific Applications (1999)Google Scholar
- 15.Reed, R.D., Marks, R.J.: Neural Smithing: Supervised Learning in Feedforward Artificial Neural Networks. MIT Press, Cambridge (1999)Google Scholar