Advertisement

Does Use of Development Model Affect Estimation Accuracy and Bias?

  • Kjetil Moløkken
  • Anette C. Lien
  • Magne Jørgensen
  • Sinan S. Tanilkan
  • Hans Gallis
  • Siw E. Hove
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3009)

Abstract

Objective. To investigate how the use of incremental and evolutionary development models affects the accuracy and bias of effort and schedule estimates of software projects. Rationale. Advocates of incremental and evolutionary development models often claim that use of these models results in improved estimation accuracy. Design of study. We conducted an in-depth survey, where information was collected through structured interviews with 22 software project managers in 10 different companies. We collected and analyzed information about estimation approach, effort estimation accuracy and bias, schedule estimation accuracy and bias, completeness of delivered functionality and other estimation related information. Results. We found no impact from the development model on the estimation approach. However, we found that incremental and evolutionary projects were less prone to effort overruns. The degree of delivered functionality and schedule estimation accuracy, on the other hand, were seemingly independent of development model. Conclusion. The use of incremental and evolutionary development models may reduce the chance of effort overruns.

Keywords

Development Model Estimation Accuracy Software Project Effort Estimation Evolutionary Development 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Moløkken, K., Jørgensen, M.: A Review of Surveys on Software Effort Estimation. In: 2003 ACM-IEEE International Symposium on Empirical Software Engineering (ISESE 2003), IEEE, Italy (2003)Google Scholar
  2. 2.
    Jørgensen, M.: A Review of Studies on Expert Estimation of Software Development Effort. To appear in Journal of Systems and Software (in press), an early version of this paper can be downloaded from http://www.simula.no/publication_one.php?publication_id=444
  3. 3.
    Boehm, B., et al.: Software Estimation with COCOMO II. Prentice-Hall, Englewood Cliffs (2000)Google Scholar
  4. 4.
    Matson, J.E., Barrett, B.E., Mellichamp, J.M.: Software development cost estimation using function points. IEEE Transactions on Software Engineering 20(4), 275–287 (1994)CrossRefGoogle Scholar
  5. 5.
    Miyazaki, Y., et al.: Robust regression for developing software estimation models. Journal of Systems and Software 27(1), 3–16 (1994)CrossRefGoogle Scholar
  6. 6.
    Woodward, H.: Project Management Institute practice standard for work breakdown structures. Project Management Institute, Inc., Newton Square (2001)Google Scholar
  7. 7.
    Tausworthe, R.C.: The Work Breakdown Structure in Software Project Management. Journal of Systems and Software 1, 181–186 (1980)CrossRefGoogle Scholar
  8. 8.
    Jørgensen, M., Moløkken, K.: A Preliminary Checklist for Software Cost Management. Accepted for QSIC 2003 (2003)Google Scholar
  9. 9.
    Shepperd, M., Passing, U.: An Experiment on Software Project Size and Effort Estimation. In: 2003 ACM-IEEE International Symposium on Empirical Software Engineering (ISESE 2003), IEEE, Frascati - Monte Porzio Catone, RM (2003)Google Scholar
  10. 10.
    Engelkamp, S., Hartkopf, S., Brossler, P.: Project experience database: a report based on first practical experience. In: International Conference on Product Focused Software Process Improvement, Oulu, Finland (2000)Google Scholar
  11. 11.
    Linstone, H.A., Turoff, M.: The Delphi Method: Techniques and Applications. Addison-Wesley, London (1975)zbMATHGoogle Scholar
  12. 12.
    Taff, L.M., Borcering, J.W., Hudgins, W.R.: Estimeetings: Development estimates and a front end process for a large project. IEEE Transactions on software engineering 17(8), 839–849 (1991)CrossRefGoogle Scholar
  13. 13.
    Moløkken, K., Jørgensen, M.: Software Effort Estimation: Unstructured Group Discussion as a Method to Reduce Individual Biases. In: The 15th Annual Workshop of the Psychology of Programming Interest Group (PPIG 2003), Keele, UK (2003)Google Scholar
  14. 14.
    Moløkken, K., Jørgensen, M.: Group Processes in Software Effort Estimation. To appear in Journal of Empirical Software Engineering - (2004) (in press)Google Scholar
  15. 15.
    May, E.L., Zimmer, B.A.: The Evolutionary Development Model for Software. Hewlett-Packard Journal 47(4), 39–45 (1996)Google Scholar
  16. 16.
    Graham, D.R.: Incremental Development and Delivery for Large Software Systems. In: Kitchenham, B.A. (ed.) Software Engineering for Large Software Systems, Elsevier, Amsterdam (1990)Google Scholar
  17. 17.
    Cockburn, A.: Search of Methodology. Object Magazine, 52–56 (1994)Google Scholar
  18. 18.
    Cockburn, A.: Surviving Object-Oriented Projects. Addison-Wesley, Reading (1998)Google Scholar
  19. 19.
    Gilb, T.: Principles of Software Engineering Management. Addison-Wesley Publishing Company, Reading (1988)zbMATHGoogle Scholar
  20. 20.
    Mills, H.D.: The Management of Software Engineering, Part 1: Principles of Software Engineering. IBM Systems Journal 19(4), 414–420 (1980)CrossRefGoogle Scholar
  21. 21.
    Hendrix, T.D., Schenider, M.P.: NASA’s TReK Project: A Case Study in Using the Spiral Model of Software Development. Communications of the ACM 45(4) (2002)Google Scholar
  22. 22.
    Royce, W.: TRW’s Ada Process Model for Incremental Development of Large Software Systems. In: 12th International Conference on Software Engineering (ICSE 12), IEEE, Los Alamitos (1990)Google Scholar
  23. 23.
    Lien, A.C., Arisholm, E.: Evolutionary Development of Web-applications - Lessons learned. In: European Software Process Improvement Conference (EuroSPI 2001), Limerick Institute of Technology, Ireland (2001)Google Scholar
  24. 24.
    Crnkovic, I.: Component-Based Software Engineering - New Challenges in Software Development. Software Focus 2(4), 127–133 (2001)CrossRefGoogle Scholar
  25. 25.
    Royce, W.: Managing the development of large software systems: Concepts and techniques. In: Proceedings of IEEE WESTCON, Los Angeles (1970)Google Scholar
  26. 26.
    Abrahamson, P., et al.: Agile software development methods. Review and analysis, p. 107. VTT Publication (2002)Google Scholar
  27. 27.
    Cozby, P.C.: Methods in behavioral research, 5th edn. Mayfield Publishing Company, Mountain View (1993)Google Scholar
  28. 28.
    Conte, S.D., Dunsmore, H.E., Shen, V.Y.: Software Engineering Metrics and Models. Benjamin-Cummings, Menlo Park (1986)Google Scholar
  29. 29.
    Christensen, R.: Analysis of variance, design and regression. Applied statistical methods. Chapman & Hall/Crc, Boca Raton (1998)Google Scholar
  30. 30.
    Cohen, J.: Statistical power analysis for the behavioral sciences. Academic Press, Inc., New York (1969)Google Scholar
  31. 31.
    Siegel, S., Castellan, N.J.: Non-parametric Statistics for the Behavioral Sciences, 2nd edn. McGraw Hill College Div., New York (1988)Google Scholar
  32. 32.
    Wonnacott, T.H., Wonnacott, R.J.: Introductory statistics, 5th edn. John Wiley & Sons, Chichester (1990)Google Scholar
  33. 33.
    Paulk, M.C., et al.: Capability Maturity Model for Software (Ver 1.1). Software Engineering Institute, Pittsburgh (1993)Google Scholar
  34. 34.
    Beaumont, L.R.: ISO 9001, The Standard Interpretation, 3rd edn., Iso Easy (2002)Google Scholar
  35. 35.
    Jenkins, A.M., Naumann, J.D., Wetherbe, J.C.: Empirical Investigation of Systems Development Practices and Results. Information & Management 7, 73–82 (1984)CrossRefGoogle Scholar
  36. 36.
    Lederer, A.L., et al.: Information System Cost Estimating: A Management Perspective. MIS Quarterly 14(2), 159–178 (1990)CrossRefGoogle Scholar
  37. 37.
    Heemstra, F.J.: Software cost estimation. Information and Software Technology 34(10), 627–639 (1992)CrossRefGoogle Scholar
  38. 38.
    Phan, D.: Information Systems Project Management: an Integrated Resource Planning Perspective Model. In: Department of Management and Information Systems, Tucson, Arizona (1990)Google Scholar
  39. 39.
    Bergeron, F., St-Arnaud, J.-Y.: Estimation of Information Systems Development Efforts: A Pilot Study. Information & Management 22, 239–254 (1992)CrossRefGoogle Scholar
  40. 40.
    Bassin, K., Biyani, S.: Santhanam, Metrics to evaluate vendor-developed software based on test case execution results. IBM Systems Journal 41(1) (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Kjetil Moløkken
    • 1
  • Anette C. Lien
    • 1
  • Magne Jørgensen
    • 1
  • Sinan S. Tanilkan
    • 2
  • Hans Gallis
    • 1
  • Siw E. Hove
    • 1
  1. 1.Simula Research LaboratoryLysakerNorway
  2. 2.Department of InformaticsBlindernNorway

Personalised recommendations