Predicting Chronic Homelessness: The Importance of Comparing Algorithms using Client Histories
- 3 September 2021
- journal article
- research article
- Published by Taylor & Francis in Journal of Technology in Human Services
- Vol. 40 (2) , 122-133
Abstract
This paper investigates how to best compare algorithms for predicting chronic homelessness for the purpose of identifying good candidates for housing programs. Predictive methods can rapidly refer potentially chronic shelter users to housing but also sometimes incorrectly identify individuals who will not become chronic (false positives). We use shelter access histories to demonstrate that these false positives are often still good candidates for housing. Using this approach, we compare a simple threshold method for predicting chronic homelessness to the more complex logistic regression and neural network algorithms. While traditional binary classification performance metrics show that the machine learning algorithms perform better than the threshold technique, an examination of the shelter access histories of the cohorts identified by the three algorithms show that they select groups with very similar characteristics. This has important implications for resource constrained not-for-profit organizations since the threshold technique can be implemented using much simpler information technology infrastructure than the machine learning algorithms.Keywords
All Related Versions
Funding Information
- Natural Sciences and Engineering Research Council of Canada (Discovery Grant)
This publication has 11 references indexed in Scilit:
- Predictors of Adolescents' First Episode of Homelessness Following Substance Use TreatmentJournal of Adolescent Health, 2020
- Allocating Interventions Based on Predicted Outcomes: A Case Study on Homelessness ServicesProceedings of the AAAI Conference on Artificial Intelligence, 2019
- Predictive modeling of housing instability and homelessness in the Veterans Health AdministrationHealth Services Research, 2018
- Applications of Machine Learning Methods to Predict Readmission and Length-of-Stay for Homeless Families: The Case of Win Shelters in New York CityJournal of Technology in Human Services, 2018
- Refinement and selection heuristics in subgroup discovery and classification rule learningExpert Systems with Applications, 2017
- Targeting Services to Individuals Most Likely to Enter Shelter: Evaluating the Efficiency of Homelessness PreventionSocial Service Review, 2016
- Testing Alternative Definitions of Chronic HomelessnessPsychiatric Services, 2015
- Efficient Targeting of Homelessness Prevention Services for FamiliesAmerican Journal of Public Health, 2013
- Unsupervised stratification of cross-validation for accuracy estimationArtificial Intelligence, 2000
- Applying Cluster Analysis to Test a Typology of Homelessness by Pattern of Shelter Utilization: Results from the Analysis of Administrative DataAmerican Journal of Community Psychology, 1998