Parallel Approaches to the Numerical Transient Analysis of Stochastic Reward Nets

  • Susann Allmaier
  • David Kreische
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1639)


This paper presents parallel approaches to the complete transient numerical analysis of stochastic reward nets (SRNs) for both shared and distributed-memory machines. Parallelization concepts and implementation issues are discussed for the three main analysis steps that are (1) generation of the underlying continuous-time Markov chain (CTMC), (2) solving the CTMC numerically for the desired time points and (3) converting the results back to the net level by evaluating reward based result measure functions. The distributed-memory approach implements dynamic load balancing mechanisms in step (1) to guarantee an equal distribution of the state space onto the main memories of the clustered machines. The shared-memory algorithms are based on elaborated synchronization mechanisms which allow parallel read and write access to the global irregular data structure of the CTMC. Performance measurements on different architectures and a comparison of the approaches are given. All the algorithms are integrated in PANDA which consequently is a parallel SRN modeling tool suitable for different multiprocessor platforms.


Transient Solution Rate Reward Master Process Linear List Markov Reward Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    S. Allmaier and S. Dalibor. PANDA —; Petri net ANalysis and Design Assistant. In Tools Descriptions, 9th int. Conference on Modeling Techniques and Tools for Computer Performance Evaluation (Tools’97), St. Malo, France, 1997.Google Scholar
  2. 2.
    S. Allmaier and G. Horton. Parallel shared-memory state-space exploration in stochastic modeling. In G. Bilardi et al, editor, Solving Irregularly Structured Problems in Parallel. Springer, LNCS 1253, 1997.Google Scholar
  3. 3.
    G. Balbo. On the success of stochastic Petri nets. In Proc. IEEE Int. Conf. Petri Nets and Perf. Models (PNPM’ 95), pages 2–9, Durham, NC, 1995.Google Scholar
  4. 4.
    S. Caselli, G. Conte, and P. Marenzoni. Parallel state space exploration for GSPN models. In Proc. IEEE Int. Conf. on Appl. and Theory of Petri nets, Torino, Italy, 1995.Google Scholar
  5. 5.
    G. Ciardo, A. Blakemore, P.F. Chimento, J.K. Muppala, and K.S. Trivedi. Automated generation and analysis of Markov reward models using stochastic reward nets. In C. Meyer and R.J. Plemmons, editors, Linear Algebra, Markov Chains and Queueing Models. Springer, 1992. IMA Vol. in Math. and Appl., vol. 48.Google Scholar
  6. 6.
    G. Ciardo, J. Gluckman, and D. Nicol. Distributed state-space generation of discrete-state stochastic models. ORSA J. Comp. To appear.Google Scholar
  7. 7.
    G. Ciardo and A.S. Miner. Storage alternatives for large structured state spaces. In R. Marie et al, editor, Computer Perf. Eval. Springer, LNCS 1245, 1997.Google Scholar
  8. 8.
    G. Ciardo, J. Muppala, and K.S. Trivedi. SPNP: stochastic Petri net package. In Proc. IEEE 3rd Int. Conf. Petri Nets and Performance Models (PNPM’ 89), pages 142–151, Kyoto, Japan, 1989.Google Scholar
  9. 9.
    D. Comer. The ubiquitous B-tree. Computing Surveys, 11(2):121–137, 1979.zbMATHCrossRefGoogle Scholar
  10. 10.
    Message Passing Interface Forum. MPI: a message-passing interface standard. J. Supercomputer Appl. and High Perf. Comp., 8, 1994.Google Scholar
  11. 11.
    A. Geist, A. Beguelin, J. Dongarra, W. Jiang, R. Manchek, and V. Sunderam. PVM: Parallel Virtual Machine. MIT Press, 1994.Google Scholar
  12. 12.
    R. German. SPNL: Processes as language-oriented building blocks of stochastic Petri nets. In R. Marie et al, editor, Comp. Perf. Eval. Springer, LNCS 1245, 1997.Google Scholar
  13. 13.
    D. Knuth. The Art of Computer Programming: Sorting and Searching, volume 3. Addison-Wesley, 1973.Google Scholar
  14. 14.
    P. Marenzoni, S. Caselli, and G. Conte. Analysis of large GSPN models: A distributed solution tool. In Proc. IEEE Int. Conf. Petri Nets and Perf. Models (PNPM’ 97), St. Malo, France, 1997.Google Scholar
  15. 15.
    M. Ajmone Marsan, G. Balbo, and G. Conte. Performance models of multiprocessor systems. MIT Press, 1986.Google Scholar
  16. 16.
    M. Ajmone Marsan, G. Balbo, G. Conte, S. Donatelli, and G. Franceschinis. Modelling with generalized stochastic Petri nets. Wiley, 1995.Google Scholar
  17. 17.
    A.L. Reibman, R.M. Smith, and K.S. Trivedi. Markov and Markov reward model transient analysis: an overview of numerical approaches. European J. Operations Research, pages 257–267, 1989.Google Scholar
  18. 18.
    A.L. Reibman and K.S. Trivedi. Transient analysis of cumulative measures of Markov model behaviour. Stochastic Models, 5(4):683–710, 1989.zbMATHCrossRefMathSciNetGoogle Scholar
  19. 19.
    W. J. Stewart. Introduction to the Numerical Solution of Markov Chains. Princeton University Press, Princeton, New Jersey, 1994.zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1999

Authors and Affiliations

  • Susann Allmaier
    • 1
  • David Kreische
    • 1
  1. 1.Lehrstuhl für Rechnerstrukturen (IMMD III)Universität Erlangen-NürnbergErlangenGermany

Personalised recommendations