A Neural Network Based Methodology for Performance Evaluation of Parallel Systems

  • Sırma Yavuz
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3809)


In this study we propose a method using multi layer perceptron (MLP) neural networks to evaluate and predict the performance of parallel systems and report our findings. Artificial neural networks may provide a good alternative to conventional methods in terms of identifying the contribution of individual system and application parameters to performance. Neural network models presented here are used to predict the computational and communication performance of parallel applications running on different platforms. Two applications are considered: the first one is a 2-Dimensional Fast Fourier Transform (FFT) application that requires intensive data exchange between processors, which is valuable for communication performance tests and the second one is a Monte Carlo application which can be classified as a typical floating-point application. There are two types of data used to train, validate and test the neural network models. A large portion of the input data composed from real measurements taken on SunSparc workstations. To enhance the available data, results obtained by modeling some unavailable systems into PACE (the Performance Analysis and Characterization Environment) have been also included.


Neural Network Fast Fourier Transform Neural Network Model Multi Layer Perceptron Application Parameter 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Yuan, C., Niemann, H.: An appearance based neural image processing algorithm for 3-D object recognition. In: Proceedings of International Conference on Image Processing, vol. 3, pp. 344–347 (2000)Google Scholar
  2. 2.
    Dongarra, J.J., Martin, J., Worlton, J.: Computer Benchmarking Paths And Pitfalls. IEEE Computer 24, 38–43 (1987)Google Scholar
  3. 3.
    Gropp, W., Lusk, E., Skjellum, A.: Using MPI: Portable Parallel Programming with the Message Passing Interface, 2nd edn. Scientific and Engineering Computation Series. The MIT Press, Cambridge (1999)Google Scholar
  4. 4.
    Hagan, M., Menhaj, M.: Training Feedforward Networks with the Marquardt Algorithm. IEEE Transactions on Neural Networks 5(6), 989–993 (1994)CrossRefGoogle Scholar
  5. 5.
    Han, J., Kamber, M.: Data mining concepts and techniques. Academic Press, San Francisco (2001)Google Scholar
  6. 6.
    Jackel, P.: Monte Carlo Methods in Finance. John Wiley & Sons Ltd., England (2002)Google Scholar
  7. 7.
    Jain, R.: The Art of Computer Systems Performance Analysis - Techniques for Experimental Design, Measurement, Simulation and Modelling. John Wiley & Sons Ltd., Chichester (1991)Google Scholar
  8. 8.
    Jain Anil, K., Mao, J., Mohiuddin, K.M.: Artificial Neural Networks: A Tutorial. IEEE Computer 29(3), 31–44 (1996)Google Scholar
  9. 9.
    John, L.K.: More on finding a single number to indicate overall performance of a benchmark suite. ACM SIGARCH Computer Architecture News 32(1) (March 2004)Google Scholar
  10. 10.
    Knuth, E.D.: The art of computer programming, 2nd edn. Addison-Wesley, Reading (1981)zbMATHGoogle Scholar
  11. 11.
    Lilja David, J.: Measuring computer performance: a practitioner’s guide. Cambridge University Press, New York (2000)CrossRefGoogle Scholar
  12. 12.
    Neji, Z., Beji, F.M.: Neural Network and Time Series Identification and Prediction. In: IEEE INNS-ENNS International Joint Conference on Neural Networks (IJCNN 2000), Italy, vol. 4 (2000)Google Scholar
  13. 13.
    Nudd, G.R., Kerbyson, D.J., Papaefstathiou, E., Harper, J.S., Perry, S.C., Wilcox, D.V.: PACE: A toolset for the performance prediction of parallel and distributed systems. Journal of High Performance and Scientific Applications (1999)Google Scholar
  14. 14.
    Pacheco Peter, S.: Parallel Programming with MPI. Morgan Kaufmann, San Francisco (1997)zbMATHGoogle Scholar
  15. 15.
    Reed, R.D., Marks, R.J.: Neural Smithing: Supervised Learning in Feedforward Artificial Neural Networks. MIT Press, Cambridge (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Sırma Yavuz
    • 1
  1. 1.Computer Engineering DepartmentYıldız Technical UniversityBeşiktaş, İstanbulTurkey

Personalised recommendations