Identifying secondary crashes using text mining techniques
Authors:
- 7 April 2019
- journal article
- research article
- Published by Taylor & Francis in Journal of Transportation Safety & Security
- Vol. 12 (10) , 1338-1358
Abstract
Secondary crashes, roadway clearance time, and incident clearance time are three primary performance measures for traffic incident management. Crash databases, which are the main source of information on secondary crashes, often fail to identify or misidentify secondary crashes. Manual reviews of crash reports can improve the accuracy of crash classification, but they are expensive and time consuming. To improve the identification of secondary crashes, this study developed a text mining approach to distinguish secondary crashes based on crash narratives. To deal with the unstructured nature of crash narratives, a four-step process involving tokenization, counting, vectorization, and normalization was implemented to transform their content into numeric vectors suitable for machine learning. Next, an evaluation of several classification models found the logistic regression model produced the most accurate classifications. A single-word representation of the narratives offered the best performance compared to more complicated schemes and is recommended for future implementation. A review of classification results showed the model is effective at identifying keywords which characterize secondary crashes. Some false classifications may be a consequence of subjective reviewer interpretations and potential mislabeling. The findings demonstrate that the text mining approach provides satisfactory performance and has great potential for identifying secondary crashes.Keywords
This publication has 37 references indexed in Scilit:
- Methods for Defining Spatiotemporal Influence Areas and Secondary Incident Detection in FreewaysJournal of Transportation Engineering, 2014
- Identifying Primary and Secondary Crashes from Spatiotemporal Crash Impact AnalysisTransportation Research Record: Journal of the Transportation Research Board, 2013
- Dynamic Incident Progression Curve for Classifying Secondary Traffic CrashesJournal of Transportation Engineering, 2010
- Application of text mining in analysing road crashes for road asset management2010
- Freeway Operations, Spatiotemporal-Incident Characteristics, and Secondary-Crash OccurrenceTransportation Research Record: Journal of the Transportation Research Board, 2010
- Identifying fall-related injuries: Text mining the electronic medical recordInformation Technology and Management, 2009
- Are Incident Durations and Secondary Incidents Interdependent?Transportation Research Record: Journal of the Transportation Research Board, 2009
- Identifying Secondary Crashes and Their Contributing FactorsTransportation Research Record: Journal of the Transportation Research Board, 2009
- Overview and semantic issues of text miningACM SIGMOD Record, 2007
- Occurrence of Secondary Crashes on Urban Arterial RoadwaysTransportation Research Record: Journal of the Transportation Research Board, 1997