Abstract
In credit scoring, feature selection aims at removing irrelevant data to improve the performance of the scorecard and its interpretability. Standard feature selection techniques are based on statistical criteria such as correlation. Recent studies suggest that using profit-based indicators for model evaluation may improve the quality of scoring models for businesses. We extend the use of profit measures to feature selection and develop a wrapper-based framework that uses the Expected Maximum Profit measure (EMP) as a fitness function. Experiments on multiple credit scoring data sets provide evidence that EMP-maximizing feature selection helps to develop scorecards that yield a higher expected profit compared to conventional feature selection strategies.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Baesens, B., Van Gestel, T., Viaene, S., Stepanova, M., Suykens, J., Vanthienen, J.: Benchmarking state-of-the-art classification algorithms for credit scoring. J. Oper. Res. Soc. 54(6), 627–635 (2003). https://doi.org/10.1057/palgrave.jors.2601545
Baesens, B., Roesch, D., Scheule, H.: Credit Risk Analytics: Measurement Techniques, Applications, and Examples in SAS. Wiley, Hoboken (2016). https://dx.doi.org/10.1002/9781119449560
Bolón-Canedo, V., Sánchez-Maroño, N., Alonso-Betanzos, A.: Recent advances and emerging challenges of feature selection in the context of big data. Knowl.-Based Syst. 86, 33–45 (2015). https://dx.doi.org/10.1016/j.knosys.2015.05.014
Chandrashekar, G., Sahin, F.: A survey on feature selection methods. Comput. Electr. Eng. 40(1), 16–28 (2014). https://dx.doi.org/10.1016/j.compeleceng.2013.11.024
Finlay, S.: Credit scoring for profitability objectives. Eur. J. Oper. Res. 202(2), 528–537 (2010). https://dx.doi.org/10.1016/j.ejor.2009.05.025
Guyon, I., Gunn, S., Nikravesh, M., Zadeh, L.A.: Feature Extraction: Foundations and Applications. Studies in Fuzziness and Soft Computing. Springer, Berlin (2006). https://dx.doi.org/10.1007/978-3-540-35488-8
Hand, D.J.: Good practice in retail credit scorecard assessment. J. Oper. Res. Soc. 56(9), 1109–1117 (2005). https://dx.doi.org/10.1057/palgrave.jors.2601932
Lessmann, S., Baesens, B., Seow, H.V., Thomas, L.C.: Benchmarking state-of-the-art classification algorithms for credit scoring: an update of research. Eur. J. Oper. Res. 247(1), 124–136 (2015). https://dx.doi.org/10.1016/j.ejor.2015.05.030
Maldonado, S., Bravo, C., Lopez, J., Pérez, J.: Integrated framework for profit-based feature selection and SVM classification in credit scoring. Decis. Support. Syst. 104, 113–121 (2017). https://doi.org/10.1016/j.dss.2017.10.007
Maldonado, S., Pérez, J., Bravo, C.: Cost-based feature selection for support vector machines: an application in credit scoring. Eur. J. Oper. Res. 261(2), 656–665 (2017). https://dx.doi.org/10.1016/j.ejor.2017.02.037
Min, F., Hu, Q., Zhu, W.: Feature selection with test cost constraint. Int. J. Approx. Reason. 55(1), 167–179 (2014). https://dx.doi.org/10.1016/j.ijar.2013.04.003
Serrano-Cinca, C., Gutiérrez-Nieto, B: The use of profit scoring as an alternative to credit scoring systems in peer-to-peer (P2P) lending. Decis. Support. Syst. 8, 113–122 (2016). https://dx.doi.org/10.1016/j.dss.2016.06.014
Thomas, L.C., Edelman, D.B., Crook, J.N.: Credit Scoring and Its Applications. SIAM, Philadelphia (2002). https://dx.doi.org/10.1137/1.9780898718317
UCI Machine Learning Repository. http://archive.ics.uci.edu/ml/
Verbraken, T., Bravo, C., Weber, R., Baesens, B.: Development and application of consumer credit scoring models using profit-based classification measures. Eur. J. Oper. Res. 238(2), 505–513 (2014). https://dx.doi.org/10.1016/j.ejor.2014.04.001
Yang, J., Honavar, V.: Feature subset selection using a genetic algorithm. In: Feature Extraction, Construction and Selection, pp. 117–136. Springer, Boston (1998)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Kozodoi, N., Lessmann, S., Baesens, B., Papakonstantinou, K. (2019). Profit-Oriented Feature Selection in Credit Scoring Applications. In: Fortz, B., Labbé, M. (eds) Operations Research Proceedings 2018. Operations Research Proceedings. Springer, Cham. https://doi.org/10.1007/978-3-030-18500-8_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-18500-8_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-18499-5
Online ISBN: 978-3-030-18500-8
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)