Alleviating Class Imbalance in Actuarial Applications Using Generative Adversarial Networks
Open Access
Abstract
To build adequate predictive models, a substantial amount of data is desirable. However, when expanding to new or unexplored territories, this required level of information is rarely always available. To build such models, actuaries often have to: procure data from local providers, use limited unsuitable industry and public research, or rely on extrapolations from other better-known markets. Another common pathology when applying machine learning techniques in actuarial domains is the prevalence of imbalanced classes where risk events of interest, such as mortality and fraud, are under-represented in data. In this work, we show how an implicit model using the Generative Adversarial Network (GAN) can alleviate these problems through the generation of adequate quality data from very limited or highly imbalanced samples. We provide an introduction to GANs and how they are used to synthesize data that accurately enhance the data resolution of very infrequent events and improve model robustness. Overall, we show a significant superiority of GANs for boosting predictive models when compared to competing approaches on benchmark data sets. This work offers numerous of contributions to actuaries with applications to inter alia new sample creation, data augmentation, boosting predictive models, anomaly detection, and missing data imputation.Keywords
This publication has 49 references indexed in Scilit:
- An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristicsInformation Sciences, 2013
- Reducing the Dimensionality of Data with Neural NetworksScience, 2006
- A Fast Learning Algorithm for Deep Belief NetsNeural Computation, 2006
- A study of the behavior of several methods for balancing machine learning training dataACM SIGKDD Explorations Newsletter, 2004
- Training Products of Experts by Minimizing Contrastive DivergenceNeural Computation, 2002
- The use of the area under the ROC curve in the evaluation of machine learning algorithmsPattern Recognition, 1997
- Integral Probability Metrics and Their Generating Classes of FunctionsAdvances in Applied Probability, 1997
- Divergence measures based on the Shannon entropyIEEE Transactions on Information Theory, 1991
- Algorithm AS 136: A K-Means Clustering AlgorithmJournal of the Royal Statistical Society Series C: Applied Statistics, 1979
- On Information and SufficiencyThe Annals of Mathematical Statistics, 1951