The class imbalance problem detecting adverse drug reactions in electronic health records
- 19 September 2018
- journal article
- research article
- Published by SAGE Publications in Health Informatics Journal
- Vol. 25 (4) , 1768-1778
Abstract
This work focuses on adverse drug reaction extraction tackling the class imbalance problem. Adverse drug reactions are infrequent events in electronic health records, nevertheless, it is compulsory to get them documented. Text mining techniques can help to retrieve this kind of valuable information from text. The class imbalance was tackled using different sampling methods, cost-sensitive learning, ensemble learning and one-class classification and the Random Forest classifier was used. The adverse drug reaction extraction model was inferred from a dataset that comprises real electronic health records with an imbalance ratio of 1:222, this means that for each drug–disease pair that is an adverse drug reaction, there are approximately 222 that are not adverse drug reactions. The application of a sampling technique before using cost-sensitive learning offered the best result. On the test set, the f-measure was 0.121 for the minority class and 0.996 for the majority class.Keywords
This publication has 20 references indexed in Scilit:
- Identifying adverse drug event information in clinical notes with distributional semantic representations of contextJournal of Biomedical Informatics, 2015
- Expert guided natural language processing using one-class classificationJournal of the American Medical Informatics Association, 2015
- Coupling different methods for overcoming the class imbalance problemNeurocomputing, 2015
- Drug side effect extraction from clinical narratives of psychiatry and psychology patientsJournal of the American Medical Informatics Association, 2011
- What makes hospitalized patients more vulnerable and increases their risk of experiencing an adverse event?International Journal for Quality in Health Care, 2011
- Text mining for the Vaccine Adverse Event Reporting System: medical text classification using informative feature selectionJournal of the American Medical Informatics Association, 2011
- Temporal pattern discovery in longitudinal electronic patient recordsData Mining and Knowledge Discovery, 2009
- Anomaly detectionACM Computing Surveys, 2009
- Learning from Imbalanced DataIEEE Transactions on Knowledge and Data Engineering, 2009
- Clarifying Adverse Drug Events: A Clinician's Guide to Terminology, Documentation, and ReportingAnnals of Internal Medicine, 2004