Abstract
Software developer’s pattern of activities, level of understanding of the source code and work practices are important factors that impact the defects introduced in software during development and its post-release quality. In very recent previous research (Lee et al. in Micro interaction metrics for defect prediction, pp 311–321, 2011), process metrics and micro-interaction metrics (Lee et al. in Micro interaction metrics for defect prediction, pp 311–321, 2011) that capture developer’s interaction with the source code have been shown to be influential on software defects introduced during development. Evaluation and selection of suitable classifiers in an unbiased manner is another conspicuous research issue in metrics based software defect prediction This study investigates software defect prediction models where micro-interactions metrics (Lee et al. in Micro interaction metrics for defect prediction, pp 311–321, 2011) are used as predictors for ten Machine Leaning (ML), fifteen Evolutionary Computation (EC) and eight Artificial Immune recognition system (AIRS) classifiers to predict defective files of three sub-projects of Java project Eclipse. They are -etc, mylyn and team. While no single best classifier could be obtained with respect to various accuracy measures on all datasets, we recommend a list of learning classifiers with respect to different goals of software defect prediction (SDP). For overall better quality of classification of defective and non-defective files, measured by F-measure, ensemble methods-Random Forests, Rotation Forests, a decision tree classifier J48 and UCS an evolutionary learning classifier system are recommended. For risk-averse and mission critical software projects defect prediction, we recommend logistic, J48, UCS and Immunos-1, an artificial immune recognition system classifier. For minimizing testing of non-defective files, we recommend Random Forests, Rotation Forests, MPLCS (Memetic Pittsburgh Learning Classifier) and Generational Genetic Algorithm (GGA) classifier.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Radjenovic, D., et al.: Software fault prediction metrics: a systematic literature review. Inf. Softw. Technol. 55, 1397–1418 (2013)
Menzies, T., Greenwald, J., Frank, A.: Data mining static code attributes to learn defect predictors. IEEE Trans. Softw. Eng. 3, 2–13 (2007)
Catal, C., Diri, B.: A systematic review of software fault prediction studies. Expert Syst. Appl. 36(4), 7346–7354 (2009)
Lessmann, S., Baesens, B., Mues, C., Pietsch, S.: Benchmarking classification models for software defect prediction: a proposed framework and novel findings. IEEE Trans. Softw. Eng. 34(4), 485–496 (2008)
Abaei, G., Selamat, A.: A survey on software fault detection based on different prediction approaches. Vietnam J. Comput. Sci. 1, 79–95 (2014). doi:10.1007/s40595-013-0008-z
Lee, T., Nam, J., Han, D., Kim, S., In, H.: Micro interaction metrics for defect prediction. In: ESEC/FSE ‘11: Proceedings of the 19th ACM SIGSOFT Symposium and the 13th European Conference on Foundations of Software Engineering, pp. 311–321 (2011)
Shepperd, M., Bowes, D., Hall, T.: Researcher bias: the use of machine learning in software defect prediction. IEEE Trans. Softw. Eng. 40(6), 603–616 (2014)
Malhotra, R., Pritam, N., Singh, Y.: On the applicability of evolutionary computation for software defect prediction. In: Proceedings of ICACCI, pp. 2249–2257 (2014)
Catal, C., Diri, B., Ozumut, B.: An artificial immune system approach for fault prediction in object-oriented software. In: Proceedings of Second International Conference on Dependability of Computer Systems, pp. 238–245 (2007)
Catal, C., Diri, B.: Software fault prediction with object-oriented metrics based artificial immune recognition system. In: Proceedings of PROFES, pp. 300–314 (2007)
Malhotra, R., Khanna, M.: Analyzing software change in open source projects using artificial immune system algorithms. In: Proceedings of ICACCI, pp. 2674–2680 (2014)
Malhotra, R., Gupta, V., Khanna, M.: Applicability of inter project validation for determination of change prone classes. Int. J. Comput. Appl. (0975–8887) 97(8) (2014)
Hall, T.: A systematic literature review on fault prediction performance in software engineering. IEEE Trans. Softw. Eng. 38(6), 1276–1304 (2012)
Menzies, T., Kocagunelli, E,. Minku, L., Peters, F., Turhan, B.: Sharing Data and Models in Software Engineering. Morgan Kauffmann, Los Altos (2015)
Kaur, A., Kaur, K.: An empirical study of robustness and stability of machine learning classifiers in software defect prediction. Adv. Intell. Inf. 383–397 (2014)
Kaur, A., Kaur, K.: Performance analysis of ensemble learning for predicting defects in open source software. In: Proceedings of ICACCI, pp. 219–225 (2014)
Alcalá-Fdez, J., et al.: KEEL: a software tool to assess evolutionary algorithms to data mining problems. Soft. Comput. 13(3), 307–318 (2009). doi:10.1007/s00500-008-0323-y
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemannthe, P., Witten, I.H.: WEKA data mining software: an update. SIGKDD Explor. 11(1), 10–18 (2009)
Brownlee, J.: Artificial immune recognition system: a review and analysis. Technical Report 1–02, Swinburne University of Technology (2005)
Brownlee, J.: Learning classifier systems. Technical Report, No. 070514A, Swinburne University of Technology (2005)
Weka Plugin for AIS algorithms in Java. Available online at http://wekaclassalgossourceforge.net
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Kaur, A., Kaur, K. (2016). Micro-interaction Metrics Based Software Defect Prediction with Machine Learning, Immune Inspired and Evolutionary Classifiers: An Empirical Study. In: Satapathy, S., Das, S. (eds) Proceedings of First International Conference on Information and Communication Technology for Intelligent Systems: Volume 1. Smart Innovation, Systems and Technologies, vol 50. Springer, Cham. https://doi.org/10.1007/978-3-319-30933-0_24
Download citation
DOI: https://doi.org/10.1007/978-3-319-30933-0_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-30932-3
Online ISBN: 978-3-319-30933-0
eBook Packages: EngineeringEngineering (R0)