Skip to main content
SpringerLink
Log in

Techniques and tools for reliability and performance evaluation: Problems and perspectives

  • Invited Papers
  • Conference paper
  • First Online:
Book cover Computer Performance Evaluation Modelling Techniques and Tools (TOOLS 1994)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 794))

Abstract

Modelling techniques and tools of the future must meet the challenges presented by today's highly demanding and schedule-oriented developing environment. With the emergence of high performance and reliability systems the problem of how to analyze such systems has become increasingly more difficult. Traditional assumptions of independent events, exponential distributions and other such “convenient” assumptions no longer model systems realistically. Nevertheless, the demand for answering performance and reliability related questions during the design process has increased. In this paper we discuss some of the issues involved in integrating modeling and design during a product development process. We present a broad range of existing techniques of systems analysis. We also describe a variety of tools that have been developed to make the analysis process simpler.

This research was sponsored by IBM under the IBM/Duke University Research Agreement # RAL-R93010-00.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. M. Ajmone-Marsan and G. Chiola. On Petri nets with deterministic and exponentially distributed firing times. In Lecture Notes in Computer Science, volume 266, pages 132–145. Springer-Verlag, 1987.

    Google Scholar 

  2. M. Ajmone Marsan, G. Conte, G. Balbo, “A Class of Generalized Stochastic Petri Nets for the Performance Evaluation of Multiprocessor Systems”, ACM Transactions on Computer Systems 2(2), pp.93–122, 1984.

    Google Scholar 

  3. G. Balbo, S.C. Bruell, S. Ghanta, “Combining Queueing Networks and Stochastic Petri Nets for the Solution of Complex Models of System Behaviour”, IEEE Transactions on Computers 37(10), pp.1251–1268, 1988.

    Google Scholar 

  4. S.J. Bavuso, J. Bechta Dugan, K.S. Trivedi, E.M. Rothmann, W.E. Smith, “Analysis of Typical Fault-Tolerant Architectures using HARP”, IEEE Transactions on Reliability 36(2), pp.176–185, 1987.

    Google Scholar 

  5. H. Beilner, J. Mäter, N. Weissenberg, “Towards a Performance Modelling Environment: News on HIT”, in: Modelling Techniques and Tools for Computer Performance Evaluation, Editors: D. Potier, R. Puigjaner, Plenum Press, pp.57–75, 1989.

    Google Scholar 

  6. A. Bobbio, “Petri Nets Generating Markov Reward Models for Performance/Reliability Analysis of Degradable Systems”, in: Modelling Techniques and Tools for Computer Performance Evaluation, Editors: D. Potier, R. Puigjaner, Plenum Press, pp.353–365, 1989.

    Google Scholar 

  7. P. Buchholz, Die strukturierte Analyse Markoffscher Modelle, Informatik Fachberichte 282, Springer Verlag, 1991.

    Google Scholar 

  8. R.W. Butler, “The SURE Reliability Analysis Program”, NASA Technical Memorandum 87593, 1986.

    Google Scholar 

  9. J. P. Buzen. Computational algorithms for closed queueing networks with exponential servers. Commun. ACM., 16(9):527–531, Sept. 1973.

    Google Scholar 

  10. J.A. Carrasco, Modelacion y Evaluacion de la Tolerancia a Fallos de Sistemas Distribuidos con Capacidad de Reconfiguracion, PhD thesis, University of Catalunya, Spain, 1986.

    Google Scholar 

  11. J.A. Carrasco, J. Figueras, “Metfac: Design and Implementation of a Software Tool for Modeling and Evaluation of Complex Fault-Tolerant Computing Systems”, Proceedings FTCS 16, IEEE Computer Society Press, pp.424–429, 1986.

    Google Scholar 

  12. G. Chiola, “A Graphical Petri Net Tool for Performance Analysis”, in: Modelling Techniques and Performance Evaluation, Editors: S. Fdida, G. Pujolle, North-Holland, pp.323–333, 1987.

    Google Scholar 

  13. H. Choi, V. G. Kulkarni, and K. S. Trivedi. Markov Regenerative Stochastic Petri Nets. In 16th IFIP W.G. 7.3 Int'l Sym. on Computer Performance Modelling, Measurement and Evaluation (Performance'93), Rome, Italy, Sep. 1993.

    Google Scholar 

  14. G. Ciardo, J. Muppala, K.S. Trivedi, “SPNP: Stochastic Perti Net Package”, Proceedings of the Third International Workshop on Petri Nets and Performance Models, IEEE Computer Society Press, pp.142–151, 1989.

    Google Scholar 

  15. G. Ciardo, J. Muppala, and K. Trivedi, “Analyzing Concurrent and Fault-Tolerant Software using Stochastic Reward Nets”, Journal of Parallel and Distributed Computing, Vol. 15, pp. 255–269, 1992.

    Google Scholar 

  16. G. Ciardo, A. Blakemore, P.F.J. Chimento, J.K. Muppala, K.S. Trivedi, “Automated Generation and Analysis of Markov Reward Models using Stochastic Reward Nets”, in: Linear Algebra, Markov Chains, and Queueing Models, Editors: C. Meyer and R. J. Plemmons, Vol.48 of IMA Volumes in Mathematics and its Applications, Springer-Verlag, 1992.

    Google Scholar 

  17. G. Ciardo, and K. S. Trivedi, “Decomposition Approach for Stochastic Reward Net Models”, Performance Evaluation, Vol. 18, No. 1, pp. 37–59, July 1993.

    MathSciNet  Google Scholar 

  18. J. L. Coleman, W. Henderson, P. G. Taylor, Product Form Equilibrium Distributions and a Convolution Algorithm for Stochastic Petri Nets Research Report, University of Adelaide, 1992

    Google Scholar 

  19. A. J. Coyle, W. Henderson, P. G. Taylor, “Reduced Load Approximations for Loss Networks”, to appear in Telecommunications Systems.

    Google Scholar 

  20. J. A. Couvillion, R. Freire, R. Johnson, W.D. Obal II, A. Qureshi, M. Rai, W.H. Sanders, J.E. Tvedt, “Performability Modelling with UltraSAN”, IEEE Software, pp.69–80, September 1991.

    Google Scholar 

  21. A. Cumani, “ESP—A Package for the Evaluation of Stochastic Petri Nets with Phase-Type Distributed Transition Times”, Proceedings of the International Workshop on Timed Petri Nets, IEEE Computer Society Press, pp.144–151, 1985.

    Google Scholar 

  22. J. Bechta Dugan, R. Geist and M. Smotherman, “The Hybrid Automated Reliability Predictor”, AIAA Journal on Guidance, Control and Dynamics, Vol. 9, No. 3, May–June 1986, pp. 319–331.

    Google Scholar 

  23. R. Geist, M. Smotherman, K. S. Trivedi, J. Bechta Dugan, “Reliability Analysis of Life-Critical Systems”, Acta Informatica, Vol. 23, No. 6, Nov. 1986.

    Google Scholar 

  24. R. Geist, K.S. Trivedi, “Reliability Estimation of Fault-Tolerant Systems: Tools and Techniques”, IEEE Computer 23(7), pp.52–61, 1990.

    Google Scholar 

  25. A. Goyal, W.C. Carter, E. de Souza e Silva, S.S. Lavenberg, K.S. Trivedi, “The System Availability Estimator”, Proceedings FTCS 16, IEEE Computer Society Press, pp.84–89, 1986.

    Google Scholar 

  26. A. Goyal, P. Heidelberger, and P. Shahabuddin. Measure specific dynamic importance sampling for availability simulations. In A. Thesen, H. Grant, and W. D. Kelton, editors, Proc. of the 1987 Winter Simulation Conference, 1987.

    Google Scholar 

  27. D. Gross, D.R. Miller, “The Randomization Technique as a Modelling Tool and Solution Procedure for Transient Markov Processes”, Operations Research 32(2), pp.343–361, 1984.

    Google Scholar 

  28. B.R. Haverkort, I.G. Niemegeers, “Using Dynamic Queueing Networks as a Tool for Specifying Performability Models”, ACM Performance Evaluation Review 17(1), p.225, 1989.

    Google Scholar 

  29. B.R. Haverkort, Performability Modelling Tools, Evaluation Techniques, and Applications, Ph.D. thesis, University of Twente, 1990.

    Google Scholar 

  30. B.R. Haverkort, I.G. Niemegeers, P. Veldhuyzen van Zanten, “DyQNtool—A Performability Modelling Tool Based on the Dynamic Queueing Network Concept”, in: Computer Performance Evaluation: Modelling Techniques and Tools, Editors: G. Balbo, G. Serazzi, North-Holland, pp.181–195, 1992.

    Google Scholar 

  31. B.R. Haverkort, “Approximate Performability Modelling using Generalized Stochastic Petri Nets”, Proceedings of the 1991 International Workshop on Petri Nets and Performance Models, IEEE Computer Society Press, 1991, pp.300–309.

    Google Scholar 

  32. B. Haverkort and K. Trivedi. Specification and generation of Markov reward models. Discrete-Event Dynamic Systems: Theory and Applications 3, pp.219–247, 1993.

    Google Scholar 

  33. B.R. Haverkort, “Approximate Performability and Dependability Modelling using Generalized Stochastic Petri Nets”, Performance Evaluation 18(1), pp.61–78, 1993.

    Google Scholar 

  34. B. R. Haverkort, A.P.A. van Moorsel, and D-J Speelman. Xmgm: Performance modeling using matrix geometric techniques. In Proceedings of the 2nd Int'l workshop on modeling, analysis and simulation of computer and telecommunication systems, 1994.

    Google Scholar 

  35. B.R. Haverkort, “Performability Evaluation using DyQNtool+”, submitted for publication, 1994.

    Google Scholar 

  36. W. Henderson and P. G. Taylor, “Aggregation Methods in exact performance analysis of stochastic Petri nets”, Proceedings of the 3rd Int'l Workshop on Petri Nets and Performance Models, pp.12–18, 1989.

    Google Scholar 

  37. R.A. Howard, Dynamic Probabilistic Systems, Vol. II: Semi-Markov and Decision Processes, New York, Wiley, 1971.

    Google Scholar 

  38. A.M. Johnson Jr., M. Malek, “Survey of Software Tools for Evaluating Reliability, Availability, and Serviceability”, ACM Computing Surveys 20(4), pp.227–269, 1988.

    Google Scholar 

  39. S.C. Johnson, R.W. Butler, “Automated Generation of Reliability Models”, Proceedings of the 1988 Annual Reliability and Maintainability Symposium, pp.17–22, 1988.

    Google Scholar 

  40. V. Kulkarni, V. F. Nicola, R. M. Smith, and K. S. Trivedi. “Numerical evaluation of performability measures and job completion time in repairable fault-tolerant systems” In Proc. 16th Intl. Symp. on Fault Tolerant Computing, Vienna, Austria, July 1986. IEEE.

    Google Scholar 

  41. R. Lepold, “Tomspin: Benutzerhandbuch”, internal report Siemens AG, 1991.

    Google Scholar 

  42. R. Lepold, “PENPETt: A New Approach to Performability Modelling using Stochastic Petri Nets”, Proceedings of the First International Workshop on Performability Modelling of Computer and Communication Systems, Editors: B.R. Haverkort, I.G. Niemegeers, N.M. van Dijk, University of Twente, pp.3–17, 1991.

    Google Scholar 

  43. R. Lepold, “Performability Evaluation of a Fault-Tolerant Computer Systems using Stochastic Petri Nets”, Proceedings of the Fifth International Conference on Fault-Tolerant Computing Systems, Springer Verlag, Nürnberg, 1991.

    Google Scholar 

  44. V.O.K. Li, J.A. Silvester, “Performance Analysis of Networks with Unreliable Components”, IEEE Transactions on Communications 32(10), pp.1105–1110, 1984.

    Google Scholar 

  45. C. Lindemann, “An improved numerical algorithm for calculating steady-state solutions of deterministic and stochastic Petri net models”, Proceedings of the 4th Int'l Workshop on Petri Nets and Performance Models, 1991.

    Google Scholar 

  46. C. Lindemann, R. German, “DSPNexpress: A Software Package for Efficiently Solving Deterministic and Stochastic Petri Nets”, in: Performance Tools 1992, Editors: R. Pooley, J. Hillston, Edinburgh University Press Ltd., forthcoming, 1992.

    Google Scholar 

  47. E. A. MacNair and C. H. Sauer. Elements of practical performance modeling. Prentice Hall, Englewood Cliffs, New Jersey, USA, 1985.

    Google Scholar 

  48. Manish Malhotra Specification and Solution of Dependability Models of Fault-Tolerant Systems, Ph.D. Thesis, Dept. of Comp. Sc., Duke University, April 1993.

    Google Scholar 

  49. R. A. Marie. An approximate analytical method for general queueing networks. IEEE Trans. Software Engg., SE-5:530–538, 1979.

    Google Scholar 

  50. R. A. Marie, A. L. Reibman, K. S. Trivedi “Transient Analysis of Acyclic Markov Chains”, Performance Evalution 7, 1987.

    Google Scholar 

  51. J.F. Meyer, “On Evaluating the Performability of Degradable Computer Systems”, IEEE Transactions on Computers 29(8), pp.720–731, 1980.

    Google Scholar 

  52. J.F. Meyer, “Closed-Form Solutions of Performability”, IEEE Transactions on Computers 31(7), pp.648–657, 1982.

    Google Scholar 

  53. J.F. Meyer, A. Movaghar, W.H. Sanders, “Stochastic Activity Networks: Structure, Behavior, and Application”, Proceedings of the International Workshop on Timed Petri Nets, IEEE Computer Society Press, pp.106–115, 1985.

    Google Scholar 

  54. J.F. Meyer, “Performability: A Retrospective and Some Pointers to the Future”, Performance Evaluation, 14(3&4), pp.139–156, 1992.

    Google Scholar 

  55. K. B. Misra (Ed.), New Trends in System Reliability Evaluation, Elsevier Science Publishers, 1993.

    Google Scholar 

  56. M.K. Molloy, “Performance Analysis using Stochastic Petri Nets”, IEEE transactions on Computers 31(9), pp.913–917, 1982.

    Google Scholar 

  57. A.P.A. van Moorsel, Performability Evaluation Concepts and Techniques, Ph.D. thesis, University of Twente, Department of Computer Science, 1993.

    Google Scholar 

  58. A.P.A. van Moorsel, W.H. Sanders, “Adaptive Uniformization”, forthcoming in Stochastic Models, 1994.

    Google Scholar 

  59. M. Mulazzani, K.S. Trivedi, “Dependability Prediction: Comparison of Tools and Techniques”, Proceedings IFAC SAFECOMP, pp.171–178, 1986.

    Google Scholar 

  60. B. Müller-Clostermann, “NUMAS—A Tool for the Numerical Analysis of Computer Systems”, in: Modelling Techniques and Tools for Computer Performance Analysis, Editor: D. Potier, North-Holland, pp.141–154, 1985.

    Google Scholar 

  61. J. K. Muppala, A. Sathaye, R. Howe, K. S. Trivedi, “Dependability Modeling of a Heterogeneous VAXcluster System Using Stochastic Reward Nets”, in: Hardware and Software Fault Tolerance in Parallel Computing Systems, Editor: D. Averesky, Ellis Horwood Ltd., 1992, forthcoming.

    Google Scholar 

  62. J. Muppala and K. S. Trivedi, “Numerical Transient Solution of Finite Markovian Queueing Systems”, in: Queueing and Related Models, U. N. Bhat and I. V. Basawa (ed.), pp. 262–284, Oxford University Press, 1992.

    Google Scholar 

  63. D. Potier, M. Veran, “The Markovian Solver of QNAP2 and Examples”, in: Computer Networking and Performance Evaluation, Editors: T. Hasegawa, H. Takagi, Y. Takahashi, pp.259–279, 1986.

    Google Scholar 

  64. A.L. Reibman, K.S. Trivedi, “Transient Analysis of Cumulative Measures of Markov Model Behavior”, Stochastic Models 5(4), pp.683–710, 1989.

    Google Scholar 

  65. M. Reiser and S. S. Lavenberg. Mean value analysis of closed multichain queueing networks. J. ACM., 27(2):313–322, Apr. 1980.

    Google Scholar 

  66. R.A. Sahner, K.S. Trivedi, “Reliability Modelling using SHARPE”, IEEE Transactions on Reliability 36(2), pp.186–193, 1987.

    Google Scholar 

  67. R.A. Sahner, K.S. Trivedi, “A Software Tool for Learning About Stochastic Models”, IEEE Transactions on Education 36(1), 1993.

    Google Scholar 

  68. W.H. Sanders, J.F. Meyer, “Performability Evaluation of Distributed Systems using Stochastic Activity Networks”, Proceedings of the 1987 International Workshop on Petri Nets and Performance Models, IEEE Computer Society Press, pp.111–120, 1987.

    Google Scholar 

  69. W.H. Sanders, Construction and Solution of Performability Models Based on Stochastic Activity Networks, Ph.D. dissertation, University of Michigan, USA, 1988.

    Google Scholar 

  70. W.H. Sanders, J.F. Meyer, “Reduced Base Model Construction for Stochastic Activity Networks”, IEEE Journal on Selected Areas in Communications 9(1), pp.25–36, 1991.

    Google Scholar 

  71. C. H. Sauer and K. M. Chandy. Computer Systems Performance Modeling. Prentice-Hall, 1981.

    Google Scholar 

  72. M. Sczittnick, Techniken zur funktionalen und quantitativen Analyse von Markoffschen Rechensystemmodellen, M.Sc. thesis, University of Dortmund, August 1987.

    Google Scholar 

  73. M. Sczittnick, B. Müller-Clostermann, “MACOM—A Tool for the Markovian Analysis of Communication Systems”, in: Proceedings of the Fourth International Conference on Data Communication Systems and Their Performance, Editor: R. Puigjaner, pp.456–470, 1990.

    Google Scholar 

  74. E. de Souza e Silva, H.R. Gail, “Performability Analysis of Computer Systems: from Model Specification to Solution”, Performance Evaluation, 14(3&4), pp. 157–196, 1992.

    Google Scholar 

  75. E. de Souza e Silva, P.M. Ochoa, “State Space Exploration in Markov Models”, ACM Performance Evaluation Review 20(1), pp.152–166, 1992.

    Google Scholar 

  76. M.F. Squillante, “MAGIC: A Computer Performance Modelling Tool based on Matrix-Geometric Techniques”, in: Computer Performance Evaluation: Modelling Techniques and Tools, Eds.: G. Balbo, G. Serazzi, North-Holland, pp.411–425, 1992.

    Google Scholar 

  77. W. J. Stewart, “MARCA: Markov Chain Analyzer”, in: Numerical Solution of Markov Chains, Editor: W.J. Stewart, Marcel Dekker, 1991.

    Google Scholar 

  78. L. Tomek, V. Mainkar, R. Geist, and K. Trivedi. Reliability analysis of life-critical real-time systems. Proceedings of the IEEE, January 1994.

    Google Scholar 

  79. K.S. Trivedi, J.K. Muppala, S.P. Woolet, B.R. Haverkort, “Composite Performance and Dependability Analysis”, Performance Evaluation, 14(3&4), pp.197–215, 1992.

    Google Scholar 

  80. M. Veran, D. Potier, “QNAP2: A Portable Environment for Queueing System Modelling”, in: Modelling Techniques and Tools for Computer Performance Evaluation, Editor: D. Potier, North-Holland, pp.25–63, 1985.

    Google Scholar 

  81. W. Whitt. The queueing network analyzer. The Bell System Technical Journal, 62(9), Nov. 1983.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dept. of Electrical Engineering, Duke University, Durham, USA

    Kishor S. Trivedi

  2. Department of Computer Science, University of Twente, The Netherlands

    Boudewijn R. Haverkort

  3. Networking Systems Hardware, IBM Corp., RTP, USA

    Andy Rindos

  4. Department of Computer Science, Duke University, Durham, USA

    Varsha Mainkar

Authors
  1. Kishor S. Trivedi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Boudewijn R. Haverkort
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Andy Rindos
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Varsha Mainkar
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Günter Haring Gabriele Kotsis

Rights and permissions

Reprints and permissions

Copyright information

© 1994 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Trivedi, K.S., Haverkort, B.R., Rindos, A., Mainkar, V. (1994). Techniques and tools for reliability and performance evaluation: Problems and perspectives. In: Haring, G., Kotsis, G. (eds) Computer Performance Evaluation Modelling Techniques and Tools. TOOLS 1994. Lecture Notes in Computer Science, vol 794. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-58021-2_1

Download citation

  • DOI: https://doi.org/10.1007/3-540-58021-2_1

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-58021-8

  • Online ISBN: 978-3-540-48416-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation