A Partially Interpretable Adaptive Softmax Regression for Credit Scoring
Open Access
- 3 April 2021
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 11 (7) , 3227
Abstract
Credit scoring is a process of determining whether a borrower is successful or unsuccessful in repaying a loan using borrowers’ qualitative and quantitative characteristics. In recent years, machine learning algorithms have become widely studied in the development of credit scoring models. Although efficiently classifying good and bad borrowers is a core objective of the credit scoring model, there is still a need for the model that can explain the relationship between input and output. In this work, we propose a novel partially interpretable adaptive softmax (PIA-Soft) regression model to achieve both state-of-the-art predictive performance and marginally interpretation between input and output. We augment softmax regression by neural networks to make it adaptive for each borrower. Our PIA-Soft model consists of two main components: linear (softmax regression) and non-linear (neural network). The linear part explains the fundamental relationship between input and output variables. The non-linear part serves to improve the prediction performance by identifying the non-linear relationship between features for each borrower. The experimental result on public benchmark datasets shows that our proposed model not only outperformed the machine learning baselines but also showed the explanations that logically related to the real-world.Keywords
Funding Information
- National Research Foundation of Korea (2019K2A9A2A06020672, 2020R1A2B5B02001717)
This publication has 38 references indexed in Scilit:
- A better Beta for the H measure of classification performancePattern Recognition Letters, 2014
- An experimental comparison of classification algorithms for imbalanced credit scoring data setsExpert Systems with Applications, 2012
- WBCD breast cancer database classification applying artificial metaplasticity neural networkExpert Systems with Applications, 2011
- A hybrid neural network approach for credit scoringExpert Systems, 2010
- Neural nets versus conventional techniques in credit scoring in Egyptian bankingExpert Systems with Applications, 2008
- A study of the behavior of several methods for balancing machine learning training dataACM SIGKDD Explorations Newsletter, 2004
- Neural network credit scoring modelsComputers & Operations Research, 2000
- A Decision-Theoretic Generalization of On-Line Learning and an Application to BoostingJournal of Computer and System Sciences, 1997
- A Credit Scoring Model for Commercial LoansJournal of Money, Credit and Banking, 1970
- The perceptron: A probabilistic model for information storage and organization in the brain.Psychological Review, 1958