A study of software reliability on big data open source software

  • Ranjan KumarEmail author
  • Subhash Kumar
  • Sanjay K. Tiwari
Original Article


With the increasing use of Open Source Software (OSS) in high speed networking, parallel processing and distributed computing, OSS has emerged as mainstream in the last decade and is now being broadly accepted even by the traditional proprietary software development companies. The major advantages of OSS over traditional software development are less development cost, availability of source code, quality and security. Software reliability—an important attribute of software quality, is defined as the probability that a software will operate free of failures or breakdown for a specified time under specified conditions (IEEE Std. 1633-2016). Investigation of Software reliability with the help of software reliability models (SRM) undertakes the estimation and prediction of the failure phenomenon of a software. In this paper we have investigated whether Non-homogeneous Poisson process (NHPP) based software reliability models fit in the big data open source software fault/bug data. We have extracted real and latest bug/fault data of Hadoop and Spark–open source big data applications, from bug tracking/management tool Jira. For this purpose, we have also compared these models on different goodness-of-fit and prediction criteria based on collected failure data to ascertain whether a best fitted model can also be a best predictor. It is found that the best model fitting the failure data is not a best predictor model.


Bug Goodness of fit NHPP OSS 



The authors are very grateful and thankful to the anonymous Referees and the Editor, whose comments have helped greatly in the presentation of this manuscript. The authors gratefully acknowledge the assistance of Professor Priya Ranjan, Department of Electrical and Electronics Engineering, Amity University, Noida in providing valuable inputs.


  1. Apache Website (2018). Accessed 26 March 2018
  2. Goel AL, Okumoto K (1979) Time dependent error detection rate model for software reliability and other performance measures. IEEE Trans Reliab 28:206211zbMATHGoogle Scholar
  3. Kapur PK, Garg RB (1992) A software reliability growth model for error removal phenomenon. Softw Eng J 7:291–294CrossRefGoogle Scholar
  4. Kapur PK, Garg RB, Kumar S (1999) Contributions to hardware and software reliability. World Scientific, SingaporeCrossRefzbMATHGoogle Scholar
  5. Kapur PK, Pham H, Gupta A, Jha PC (2011) Software reliability assessment with OR applications. Springer, LondonCrossRefzbMATHGoogle Scholar
  6. Lai R, Garg M (2012) A detailed study of NHPP software reliability models. J Softw 7(6):1296–1306CrossRefGoogle Scholar
  7. Li Q, Pham H (2017) A testing-coverage software reliability model considering fault removal efficiency and error generation. PLoS ONE 12(7):e0181524. CrossRefGoogle Scholar
  8. Li X et al (2011) Reliability analysis and optimal release-updating for open source software. Inf Softw Technol 53:929936CrossRefGoogle Scholar
  9. Lyu MR (1996) Handbook of sofware reliability engineering. IEEE Computer Society Press, Los AlamitosGoogle Scholar
  10. Ohba M, Osaki S (1984) Inflexion S-shaped software reliability growth models, stochastic models in reliability theory. Springer, p 144162Google Scholar
  11. Pham H, Nordmann L, Zhang X (1999) A general imperfect software debugging model with S-shaped fault detection rate. IEEE Trans Reliab 48:169175Google Scholar
  12. Pillai K, Nair VSS (1997) A model for software development effort and cost estimation. IEEE Transactions on Software Engineering 23(8):485–497CrossRefGoogle Scholar
  13. Rahmani C et al (2010) A comparative analysis of open source software reliability. J Softw 5(12):1384–1394CrossRefGoogle Scholar
  14. Rahmani C et al (2010) Exploratory failure analysis of open source software. In: 2nd International conference on software technology and engineering (ICSTE). IEEE Explore, vol 2, pp 51–56Google Scholar
  15. Raymond ES (1999) The cathedral and the bazaar: musings on open source by an acci-dental revolutionary. OReilly & Associates, SebastopolCrossRefGoogle Scholar
  16. Rossi B et al (2010) Modelling failures occurrences of open source software with reliability growth. J Open Source Softw New Horizons 268–280Google Scholar
  17. Singh VB, Sujata K, Kapur PK (2010) A reliability growth model for object oriented software developed under concurrent distributed development environment. In: Proceedings of 2nd international conference on reliability safety and hazard, IEEE, pp 479–484Google Scholar
  18. Singh VB, Kapur PK, Tandon A (2010) Measuring reliability growth of open source software using stochastic differential equations. In: Proceedings of second world congress on software engineering (WCSE) at Huwan, China, IEEE XploreGoogle Scholar
  19. Singh VB, Kapur PK, R Kumar (2010) Developing S-shaped software reliability growth model for open source software. In: Proceedings of IASTED international conference on software engineering at Austria, ACTA PressGoogle Scholar
  20. SinghVB, Singh OP, Kumar R, Kapur PK (2010) A generalized reliability growth model for open source software. In: Proceedings of 2nd international conference on reliability safety and hazard, IEEE, pp 523–528Google Scholar
  21. Stallman R (1998) The GNU project.
  22. IEEE Std 1633-2008 (2008) IEEE recommended practice in software reliabilityGoogle Scholar
  23. Syed-Mohamad SM et al (2008) Reliability growth of open source software using defect analysis. In: International conference on computer science and software engineeringGoogle Scholar
  24. Tamura Y, Yamada S (2009) Optimization analysis for reliability assessment based on stochastic differential equation modeling for open source software. Int J Syst Sci 40(4):429–438CrossRefzbMATHGoogle Scholar
  25. Tamura Y, Yamada S (2010) Performance evaluation of reliability assessment method based on stochastic differential equation model for large-scale open source solution. Int J Syst Assur Eng Manag 1(4):324–329CrossRefGoogle Scholar
  26. van de Joode RW, de Bruijne M (2006) The organization of open source communities: towards a framework to analyze the relationship between openness and reliability. In: Proceedings of 39th Hawaii international conference on system sciences, pp 1–6Google Scholar
  27. Ven K, Verelst J, Mannaert H (1998) Should you adopt open source soft-ware? IEEE Softw 25(3):54–59CrossRefGoogle Scholar
  28. Yamada S (2014) Software reliability modelling: fundamental and applications. Springer, Tokyo/HiedelbergCrossRefGoogle Scholar
  29. Yamada S (2017) Elementary software reliability growth modelling. In: 6th International conference on reliability, Infocom technologies and optimization (ICRITO), Noida, pp 2–10Google Scholar
  30. Yamada S, Tamura Y (2016) OSS Reliability Measurement and Assessment. Springer, Cham ISBN: 978-3-319-31818-9 CrossRefGoogle Scholar
  31. Yamada S, Ohba M, Osaki S (1983) S-shaped reliability growth modeling for software fault detection. IEEE Trans Reliab 32:475484Google Scholar
  32. Zhou Y et al (2005) Open source software reliability model: an empirical method. In: ACM SIGSOFT software engineering notesGoogle Scholar
  33. Zou F et al (2008) Analyzing and modeling open source software bug report data. In: 19th Australian conference on software engineeringGoogle Scholar
  34. Zou F, Davis J (2008) Analyzing and modeling open source software bug report data. In: 19th Australian conference on software, IEEE Computer Society.

Copyright information

© The Society for Reliability Engineering, Quality and Operations Management (SREQOM), India and The Division of Operation and Maintenance, Lulea University of Technology, Sweden 2019

Authors and Affiliations

  1. 1.Department of Computer ScienceAryabhatta College (University of Delhi)New DelhiIndia
  2. 2.Department of PhysicsAcharya Narendra Dev College (University of Delhi)New DelhiIndia
  3. 3.Post Graduate Department of MathematicsMagadh UniversityBodh Gaya, GayaIndia

Personalised recommendations