Skip to main content
SpringerLink
Log in

Performance Evaluation Approaches for Software Architects

  • Chapter
Component-Based Software Development for Embedded Systems

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 3778))

Abstract

Performance analysis techniques have already been developed for decades. As software architecture research has matured, performance analysis techniques have also been adapted to the evaluation of software architectures. However, the performance evaluation of software architectures is not yet systematically used in the industry. One of the reasons may be that it is difficult to select what method to use. The contribution of this work is to define a comparison framework for performance evaluation approaches. In addition, the framework is applied in comparing existing performance evaluation approaches. The framework can be used to select methods for evaluating architectures, to increase understanding of the methods, and to point out needs for future work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 16.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Balsamo, S., Marco, A.D., Inverardi, P., Simeoni, M.: Software Performance State of the Art and Perspectives. Dipartimento di Informatica, Unversità Ca’Foscari di Venezia, Research Report CS-2003-1 (January 2003)

    Google Scholar 

  2. IEEE, IEEE Recommended Practice for Architectural Description of Software-Intensive Systems. IEEE Std 1471-2000 (2000)

    Google Scholar 

  3. Smith, C.U.: Performance Engineering of Software Systems. Addison-Wesley, Reading (1990)

    Google Scholar 

  4. Clements, P., Kazman, R., Klein, M.: Evaluating Software Architecture: Methods and Case Studies. Addison-Wesley, Reading (2001)

    Google Scholar 

  5. Aquilani, F., Balsamo, S., Inverardi, P.: Performance Analysis at the Software Architectural Design Level. Performance Evaluation 45, 147-178 (2001)

    Article  MATH  Google Scholar 

  6. Smith, C.U., Williams, L.G.: Performance Solutions: A Practical Guide to Creating Responsive, Scalable Software. Addison-Wesley, Boston (2002)

    Google Scholar 

  7. Kähkipuro, P.: Performance Modeling Framework for CORBA Based Distributed Systems. University of Helsinki (2000)

    Google Scholar 

  8. Shousha, C., Petriu, D., Jalnapurkar, A., Ngo, K.: Applying Performance Modelling to a Telecommunication System. In: Proceedings of The First InternationalWorkshop on Software and Performance (WOSP 1998), Santa Fe, New Mexico, USA (1998)

    Google Scholar 

  9. King, P., Pooley, R.: Derivation of Petri Net Performance Models from UML Specification of Communication Software. In: Proceedings of XV UK Performance Engineering Workshop (1999)

    Google Scholar 

  10. Fukuzawa, K., Saeki, M.: Evaluating Software Architectures by Coloured Petri Nets. In: Proceedings of the 14th International Conference on Software Engineering and Knowledge Engineering (SEKE 2002), Ischia, Italy (2002)

    Google Scholar 

  11. Xu, J., Kuusela, J.: Analyzing the Execution Architecture of Mobile Phone Software with Colored Petri Nets. International Journal on Software Tools for Technology Transfer 2, 133–143 (1998)

    Article  MATH  Google Scholar 

  12. Bernardo, M., Ciancarini, P., Donatiello, L.: Architecting Families of Software Systems with Process Algebras. ACM Transactions on Software Engineering and Methodology 11, 386–426 (2002)

    Article  Google Scholar 

  13. Herzog, U., Rolia, J.: Performance Validation Tools for Software/Hardware Systems. Performance Evaluation 45, 125–146 (2001)

    Article  MATH  Google Scholar 

  14. Klein, M.H., Ralya, T., Pollak, B., Obenza, R., Harbour, M.G.: A Practioner’s Handbook for Real-Time Analysis: Guide to RateMonotonic Analysis for Real-Time Systems. Kluwer, Dordrecht (1993)

    Google Scholar 

  15. Pooley, R.: Software Engineering and Performance: a Roadmap. In: Proceedings of the 22nd International Conference on Software Engineering, Future of Software Engineering Track, Limerick, Ireland (2000)

    Google Scholar 

  16. Petriu, D., Shousha, C., Jalnapurkar, A.: Architecture-Based Performance Analysis Applied to a Telecommunication System. IEEE Transactions on Software Engineering 26, 1049–1065 (2000)

    Article  Google Scholar 

  17. Williams, L.G., Smith, C.U.: PASA: A method for the Performance Assessment of Software Architectures. In: Proceedings of the 3rd International Workshop on Software and Performance, Rome, Italy (2002)

    Google Scholar 

  18. Hrischuk, C.E., Woodside, C.M., Rolia, J.a., Iversen, R.: Trace-Based Load Characterization for Generating Performance Software Models. IEEE Transactions on Software Engineering 25, 122–135 (1999)

    Article  Google Scholar 

  19. Rolia, J.A., Sevcik, K.C.: The Method of Layers. IEEE Transactions on Software Engineering 21, 689-700 (1995)

    Article  Google Scholar 

  20. Franks, G., Hubbard, A., Majumdar, S., Petriu, D., Rolia, J., Woodside, M.: A Toolset for Performance Engineering and Software Design of Client-Server Systems. Performance Evaluation 24, 117-135 (1995)

    Article  MATH  Google Scholar 

  21. Afsharian, S., Giuli, M., Tarani, G.: Quantitative Analysys for Telecom/Datacom Software Architecture. In: Proceedings of the third International Workshop on Software and Performance, Rome, Italy (2002)

    Google Scholar 

  22. Balsamo, S., Simeoni, M.: Deriving Performance Models from Software Architecture Specifications. In: Proceedings of the European Simulation Multiconference (ESM 2001), Prague (2001)

    Google Scholar 

  23. Balsamo, S., Personeè, V.D.N., Inverardi, P.: A Review on Queuing Network Models with Finite Capacity Queues for Software Architectures Performance Prediction. Performance Evaluation (2002)

    Google Scholar 

  24. Kazman, R., Bass, L.: Making Architecture Reviews Work in the Real World. IEEE Software 19, 67-73 (2002)

    Article  Google Scholar 

  25. OMG, Unified Modelling Language, http://www.uml.org

  26. Medvidovic, N., Taylor, R.N.: A Classification and Comparison Framework for Software Architecture Description Languages. IEEE Transactions on Software Engineering 26, 70-93 (2000)

    Article  Google Scholar 

  27. Liu, C.L., Layland, J.W.: Scheduling Algorithms for Multi-Programming in a Hard Real- Time Environment. Journal of the Association for Computing Machinery 20, 46-61 (1973)

    MATH  MathSciNet  Google Scholar 

  28. Obenza, R.: Guaranteeing Real-Time Performance Using RMA. Embedded Systems Programming, 26–40 (1994)

    Google Scholar 

  29. Ran, A., Lencevicius, R.: Making Sense of Runtime Architecture for Mobile Phone Software. In: Proceedings of the 11th ACM SIGSOFT Symposium on Foundations of Software Engineering held jointly with 9th European Software Engineering Conference, ESEC/FSE 2003, Helsinki, Finland (2003)

    Google Scholar 

  30. Purhonen, A.: Architecture Evaluation Strategy for DSP Software Development. In: Proceedings of the 15th International Conference of Software Systems Engineering and their Applications, Paris (2002)

    Google Scholar 

  31. TimeSys Corporation, TimeWiz, http://www.timesys.com

  32. Tri-Pacific Software Inc. RAPID, http://www.tripac.com

  33. Feiler, P.H., Lewis, B., Vestal, S.: Improving Predictability in Embedded Real-Time Systems. Carnegie Mellon University, Software Engineering Institute, Technical report CMU/SEI-2000-SR-011 (December 2000)

    Google Scholar 

  34. Performance Engineering Services, SPE*ED, http://www.perfeng.com

  35. Dilley, J., Friedlich, R., Jin, T., Rolia, J.: Measurement Tool and Modelling Techniques for Evaluating Web Server Performance. In: Proceedings of Computer Performance Evaluation Modelling Techniques and Tools (1997)

    Google Scholar 

  36. Aberer, K., Risse, T., Wombacher, A.: Configuration of Distributed Message Converter Systems Using Performance Modeling. In: Proceedings of the 20th International Performance, Computation and Communication Conference, Phoenix, Arizona (2001)

    Google Scholar 

  37. Petriu, D.C., Shen, H.: Applying the UML Performance Profile: Graph Grammar-Based Derivation of LQN Models from UML Specifications. In: Field, T., Harrison, P.G., Bradley, J., Harder, U. (eds.) TOOLS 2002. LNCS, vol. 2324, p. 159. Springer, Heidelberg (2002)

    Google Scholar 

  38. Petriu, D.C., Woodside, M.: Software Performance Models from System Scenarios in Use Case Maps. In: Field, T., Harrison, P.G., Bradley, J., Harder, U. (eds.) TOOLS 2002. LNCS, vol. 2324, p. 141. Springer, Heidelberg (2002)

    Google Scholar 

  39. Carleton University. LQNS Solver, http://www.sce.carleton.ca/rads/#softarch

  40. Kruchten, P.: The 4+1 View Model of Architecture. IEEE Software 12, 42-50 (1995)

    Article  Google Scholar 

  41. University of Aarhus. CPN Tools, http://wiki.daimi.au.dk/cpntools/cpntools.wiki

  42. Kazman, R., Klein, M., Clements, P.: Evaluating software architectures for real-time systems. Annals of Software Engineering 7, 71-93 (1999)

    Article  Google Scholar 

  43. Klein, M., Kazman, R., Bass, L., Carriere, J., Barbacci, M., Lipson, H.: Attribute-Based Architecture Styles. In: Proceedings of The First Working IFI Conference on Software Architecture (WICSA1), San Antonio, TX (1999)

    Google Scholar 

  44. Lung, C.-H., Jalnapurkar, A., El-Rayess, A.: Performance-Oriented Software Architecture Engineering – an Experience Report. In: Proceedings of the First International Workshop on Software and Performance, Santa Fe, New Mexico (1998)

    Google Scholar 

  45. Kauppi, T.: Performance Analysis at the Software Architectural Level. VTT Electronics, VTT Publications 512 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. VTT Technical Research Centre of Finland, P.O. Box 1100, FI-90571, Oulu, Finland

    Anu Purhonen

Authors
  1. Anu Purhonen
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Chair of Software Technology, University Mannheim, A5, 6 B, 68131, Mannheim, Germany

    Colin Atkinson

  2. Fraunhofer IESE, Fraunhoferplatz 1, D-67663, Kaiserslautern, Germany

    Christian Bunse

  3. Embedded Software Laboratory, Delft University of Technology, Mekelweg 4, 2628 CD, Delft, The Netherlands

    Hans-Gerhard Gross

  4. Fraunhofer Institute Experimental Software Engineering, Kaiserslautern, Germany

    Christian Peper

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Purhonen, A. (2005). Performance Evaluation Approaches for Software Architects. In: Atkinson, C., Bunse, C., Gross, HG., Peper, C. (eds) Component-Based Software Development for Embedded Systems. Lecture Notes in Computer Science, vol 3778. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11591962_14

Download citation

  • DOI: https://doi.org/10.1007/11591962_14

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-30644-3

  • Online ISBN: 978-3-540-31614-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation