Validating Quality of Service for Reusable Software Via Model-Integrated Distributed Continuous Quality Assurance
Quality assurance (QA) tasks, such as testing, profiling, and performance evaluation, have historically been done in-house on developer-generated workloads and regression suites. Performance-intensive systems software, such as that found in the scientific computing grid and distributed real-time and embedded (DRE) domains, increasingly run on heterogeneous combinations of OS, compiler, and hardware platforms. Such software has stringent quality of service (QoS) requirements and often provides a variety of configuration options to optimize QoS. As a result, QA performed solely in-house is inadequate since it is hard to manage software variability, i.e., ensuring software quality on all supported target platforms across all desired configuration options. This paper describes how the Skoll project is addressing these issues by developing advanced QA processes and tools that leverage the extensive computing resources of user communities in a distributed, continuous manner to improve key software quality attributes.
KeywordsModel Interpreter Reusable Software Quality Assurance Process Object Request Broker Generic Modeling Environment
Unable to display preview. Download preview PDF.
- 1.Memon, A., Porter, A., Yilmaz, C., Nagarajan, A., Schmidt, D.C., Natarajan, B.: Skoll: Distributed Continuous Quality Assurance. In: Proceedings of the 26th IEEE/ACM International Conference on Software Engineering, Edinburgh, Scotland, May 2004, IEEE/ACM (2004)Google Scholar
- 2.Schmidt, D.C., Huston, S.D.: C++ Network Programming, 1st edn. Mastering Complexity with ACE and Patterns. Addison-Wesley, Boston (2002)Google Scholar
- 4.Krishna, S., Balasubramanian, J., Gokhale, A., Schmidt, D.C., Sevilla, D., Thaker, G.: Empirically Evaluating CORBA Component Model Implementations. In: Proceedings of the OOPSLA 2003 Workshop on Middleware Benchmarking, Anaheim, CA, ACM, New York (October 2003)Google Scholar
- 6.Ledeczi, A., Bakay, A., Maroti, M., Volgysei, P., Nordstrom, G., Sprinkle, J., Karsai, G.: Composing Domain-Specific Design Environments. IEEE Computer (November 2001)Google Scholar
- 7.Gokhale, A.: Component Synthesis using Model Integrated Computing (2003), http://www.dre.vanderbilt.edu/cosmic
- 8.Schmidt, D.C., Stal, M., Rohnert, H., Buschmann, F.: Pattern-Oriented Software Architecture: Patterns for Concurrent and Networked Objects, 2nd edn. Wiley & Sons, New York (2000)Google Scholar
- 9.Berczuk, S., Appleton, B.: Software Configuration Management Patterns: Effective Teamwork, Practical Integration. Addison-Wesley, Reading (2003)Google Scholar
- 10.Yotov, K., Li, X., Ren, G., et al.: A Comparison of Empirical and Model-driven Optimization. In: Proceedings of ACM SIGPLAN conference on Programming Language Design and Implementation (June 2003)Google Scholar
- 11.Grundy, J., Ding, G.: Automatic Validation of Deployed J2EE Components Using Aspects. In: 17th International Conference on Automated Software Engineering, Linz Austria, September 2002, IEEE, Los Alamitos (2002)Google Scholar