Is Random Forest a Superior Methodology for Predicting Poverty? An Empirical Assessment
Open Access
- 9 March 2017
- journal article
- research article
- Published by Wiley in Poverty & Public Policy
- Vol. 9 (1) , 118-133
Abstract
Random forest (RF) is in many fields of research a common method for data‐driven predictions. Within economics and prediction of poverty, RF is rarely used. Comparing out‐of‐sample predictions in surveys for the same year in six countries shows that RF is often more accurate than current common practice (multiple imputations with variables selected by Stepwise and Lasso), suggesting that this method could contribute to better poverty predictions. However, none of the methods consistently provides accurate predictions of poverty over time, highlighting that technical model fitting by any method within a single year is not always, by itself, sufficient for accurate predictions of poverty over time.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Updating Poverty Estimates at Frequent Intervals in the Absence of Consumption Data: Methods and Illustration with Reference to a Middle-Income Country2014
- Big Data: New Tricks for EconometricsJournal of Economic Perspectives, 2014
- Weight Calculations for Panel Surveys with Subsampling and Split-off TrackingStatistics and Public Policy, 2013
- Testing Prediction Performance of Poverty Models: Empirical Evidence from UgandaReview of Income and Wealth, 2012
- Small area estimation-based prediction methods to track poverty: validation and applicationsThe Journal of Economic Inequality, 2011
- Mining data with random forests: A survey and results of new testsPattern Recognition, 2011
- Moving Up The Ladder? The Impact Of Migration Experience On Occupational Mobility In Albania2009
- Predicting Consumption Poverty using Non-Consumption Indicators: Experiments using Indonesian DataSocial Indicators Research, 2006
- Micro-Level Estimation of Poverty and InequalityEconometrica, 2003
- Random ForestsMachine Learning, 2001