Skip to main content
SpringerLink
Log in
Book cover

International Workshop on Software Measurement

IWSM 2009: Software Process and Product Measurement pp 227–241Cite as

Evaluating Process Quality Based on Change Request Data – An Empirical Study of the Eclipse Project

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 5891))

Abstract

The information routinely collected in change request management systems contains valuable information for monitoring of the process quality. However this data is currently utilized in a very limited way. This paper presents an empirical study of the process quality in the product portfolio of the Eclipse project. It is based on a systematic approach for the evaluation of process quality characteristics using change request data. Results of the study offer insights into the development process of Eclipse. Moreover the study allows assessing applicability and limitations of the proposed approach for the evaluation of process quality.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Cook, J.E., Votta, L.G., Wolf, A.L.: Cost-Effective Analysis of In-Place Software Processes. IEEE Trans. Softw. Eng. 24(8), 650–663 (1998)

    Article  Google Scholar 

  2. Grammel, L., Schackmann, H., Lichter, H.: BugzillaMetrics: An Adaptable Tool for Evaluating Metric Specifications on Change Requests. In: Ninth Intl. Workshop on Principles of Software Evolution, IWPSE 2007, Dubrovnik, Croatia, September 3-4, pp. 35–38. ACM, New York (2007)

    Google Scholar 

  3. Ebert, C., Dumke, R.: Software Measurement. Establish – Extract – Evaluate - Execute. Springer, Heidelberg (2007)

    MATH  Google Scholar 

  4. Kanat-Alexander, M.: The Bugzilla Survey (August 2008), http://wiki.mozilla.org/Bugzilla:Survey

  5. Schackmann, H., Lichter, H.: Comparison of Process Quality Characteristics Based on Change Request Data. In: Dumke, R.R., Braungarten, R., Büren, G., Abran, A., Cuadrado-Gallego, J.J. (eds.) IWSM 2008. LNCS, vol. 5338, pp. 127–140. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  6. Kagdi, H., Collard, M.L., Maletic, J.I.: A Survey and Taxonomy of Approaches for Mining Software Repositories in the Context of Software Evolution. J. Softw. Maint. Evol. 19(2), 77–131 (2007)

    Article  Google Scholar 

  7. Breu, S., Zimmermann, T., Lindig, C.: HAM: Cross-Cutting Concerns in Eclipse. In: Proc. of the 2006 OOPSLA Workshop on Eclipse Technology Exchange, Portland, Oregon, October 22-23, pp. 21–24. ACM, New York (2006)

    Chapter  Google Scholar 

  8. Hou, D.: Studying the Evolution of the Eclipse Java Editor. In: Proc. of the 2007 OOPSLA Workshop on Eclipse Technology Exchange, Montreal, Quebec, Canada, October 21, pp. 65–69. ACM, New York (2007)

    Chapter  Google Scholar 

  9. Wermelinger, M., Yu, Y.: Analyzing the Evolution of Eclipse Plugins. In: Proc. of the 2008 Intl. Working Conf. on Mining Software Repositories, Leipzig, Germany, May 10-11, pp. 133–136. ACM, New York (2008)

    Chapter  Google Scholar 

  10. Kidane, Y., Gloor, P.: Correlating Temporal Communication Patterns of the Eclipse Open Source Community with Performance and Creativity. In: Proc. of NAACSOS 2005, Notre Dame, Indiana, June 26-28 (2005)

    Google Scholar 

  11. Linstead, E., Rigor, P., Bajracharya, S., Lopes, C., Baldi, P.: Mining Eclipse Developer Contributions via Author-Topic Models. In: Proc. of the Fourth Intl. Workshop on Mining Software Repositories, Minneapolis, MN, May 19-20, p. 30. IEEE, Washington (2007)

    Chapter  Google Scholar 

  12. Herraiz, I., Gonzalez-Barahona, J.M., Robles, G.: Forecasting the Number of Changes in Eclipse Using Time Series Analysis. In: Proc. of the Fourth Intl. Workshop on Mining Software Repositories, Minneapolis, MN, May 19-20, p. 32. IEEE, Washington (2007)

    Chapter  Google Scholar 

  13. Zhang, H.: An Initial Study of the Growth of Eclipse Defects. In: Proc. of the 2008 Intl. Working Conf. on Mining Software Repositories, Leipzig, Germany, May 10-11, pp. 141–144. ACM, New York (2008)

    Chapter  Google Scholar 

  14. Panjer, L.D.: Predicting Eclipse Bug Lifetimes. In: Proc. of the Fourth Intl. Workshop on Mining Software Repositories, Minneapolis, MN, May 19-20, p. 29. IEEE, Washington (2007)

    Chapter  Google Scholar 

  15. Schuler, D., Zimmermann, T.: Mining Usage Expertise from Version Archives. In: Proc. of the 2008 Intl. Working Conf. on Mining Software Repositories, Leipzig, Germany, May 10-11, pp. 121–124. ACM, New York (2008)

    Chapter  Google Scholar 

  16. Mockus, A., Fielding, R.T., Herbsleb, J.D.: Two Case Studies of Open Source Software Development: Apache and Mozilla. ACM Trans. Softw. Eng. Methodol. 11(3), 309–346 (2002)

    Article  Google Scholar 

  17. Francalanci, C., Merlo, F.: Empirical Analysis of the Bug Fixing Process in Open Source Projects. In: Open Source Development, Communities and Quality, pp. 187–196. Springer, Boston (2008)

    Chapter  Google Scholar 

  18. Michlmayr, M., Senyard, A.: A Statistical Analysis of Defects in Debian and Strategies for Improving Quality in Free Software Projects. In: Bitzer, J., Schröder, P.J.H. (eds.) The Economics of Open Source Software Development, pp. 131–148. Elsevier, Amsterdam (2006)

    Chapter  Google Scholar 

  19. Śliwerski, J., Zimmermann, T., Zeller, A.: When Do Changes Induce Fixes? In: Proc. of the 2005 Intl. Workshop on Mining Software Repositories, St. Louis, Missouri, May 17, pp. 1–5. ACM, New York (2005)

    Chapter  Google Scholar 

  20. Koponen, T.: RaSOSS - Remote Analysis System for Open Source Software. In: Proc. of the Intl. Conf. on Software Eng. Advances, Papeete, Tahiti, French Polynesia, October 29 – November 3, pp. 54–59. IEEE, Washington (2006)

    Google Scholar 

  21. Herraiz, I., German, D.M., Gonzalez-Barahona, J.M., Robles, G.: Towards a Simplification of the Bug Report Form in Eclipse. In: Proc. of the 2008 Intl. Working Conf. on Mining Software Repositories, Leipzig, Germany, May 10-11, pp. 145–148. ACM, New York (2008)

    Chapter  Google Scholar 

  22. Bettenburg, N., Just, S., Schröter, A., Weiss, C., Premraj, R., Zimmermann, T.: What Makes a Good Bug Report? In: Proc. of the 16th ACM SIGSOFT Intl. Symp. on Foundations of Software Engineering, Atlanta, Georgia, November 9-14, pp. 308–318. ACM, New York (2008)

    Chapter  Google Scholar 

  23. Gamma, E.: Agile, Open Source, Distributed, and On-Time – Inside the Eclipse Development Process. In: Keynote Talk, 27th Intl. Conf. on Software Engineering, St. Louis, Missouri, May 15-21 (2005)

    Google Scholar 

  24. Schackmann, H., Jansen, M., Lischkowitz, C., Lichter, H.: QMetric - A Metric Tool Suite for the Evaluation of Software Process Data. In: Companion Proc. of the 31th Intl. Conf. on Software Engineering, Vancouver, Canada, May 16-22, pp. 415–416. ACM, New York (2009)

    Google Scholar 

  25. Samoladas, I., Gousios, G., Spinellis, D., Stamelos, I.: The SQO-OSS Quality Model: Measurement Based Open Source Software Evaluation. In: Open Source Development, Communities and Quality, Milano, Italy, September 7-10. IFIP, vol. 275, pp. 237–248. Springer, Boston (2008)

    Chapter  Google Scholar 

  26. Ciolkowski, M., Soto, M.: Towards a Comprehensive Approach for Assessing Open Source Projects. In: Dumke, R.R., Braungarten, R., Büren, G., Abran, A., Cuadrado-Gallego, J.J. (eds.) IWSM 2008. LNCS, vol. 5338, pp. 316–330. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Research Group Software Construction, RWTH Aachen University, Ahornstr. 55, 52074, Aachen, Germany

    Holger Schackmann, Henning Schaefer & Horst Lichter

Authors
  1. Holger Schackmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Henning Schaefer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Horst Lichter
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. École de technologie supérieure, Département de génie logiciel et des TI, Université du Québec, 1100, rue Notre-Dame Ouest, H3C 1K3, Montréal, Québec, Canada

    Alain Abran

  2. Quality Management and Methods, Processes DCC/QMP, Bosch Rexroth Electric Drives and Controls GmbH, Bürgermeister-Dr.-Nebel Str. 2, 97816, Lohr am Main, Germany

    René Braungarten

  3. Fakultät für Informatik, Institut für Verteilte Systeme, AG Softwaretechnik, Otto-von-Guericke-Universität Magdeburg, Universitätsplatz 2, 39106, Magdeburg, Germany

    Reiner R. Dumke

  4. Edificio Politécnico, Universidad de Alcalá, O24. Autovía A2, Km. 31,7, 28805, Alcalá de Henares,Madrid, Spainn

    Juan J. Cuadrado-Gallego

  5. School of Media and Communication, University of Applied Science HvA, Weesperzijde 190, 1097, Amsterdam, DZ, The Netherlands

    Jacob Brunekreef

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Schackmann, H., Schaefer, H., Lichter, H. (2009). Evaluating Process Quality Based on Change Request Data – An Empirical Study of the Eclipse Project. In: Abran, A., Braungarten, R., Dumke, R.R., Cuadrado-Gallego, J.J., Brunekreef, J. (eds) Software Process and Product Measurement. IWSM 2009. Lecture Notes in Computer Science, vol 5891. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-05415-0_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-05415-0_17

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-05414-3

  • Online ISBN: 978-3-642-05415-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation