TVTrent Victor

Trent Victor

*This is an algorithmically generated author record based on publicly available information.

Trent Victor has a total of 20 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Dynamic Benchmarks: Spatial and Temporal Alignment for Automated Driving Systems Performance Evaluation

    by Yin-Hsiu Chen, John M. Scanlon, Kristofer D. Kusano, Timothy L. McMurry, Trent Victor

    Deployed SAE level 4 automated driving systems (ADS) without a human driver are currently operating in ride-hailing fleets on surface streets in the U. S. This current use case, and future applications of this technology, will determine where and when the fleets operate, potentially resulting in a divergence from the distribution of driving of the human benchmark population within a given locality. Existing benchmarks for evaluating ADS performance have only done county-level geographical matching of ADS and benchmark driving exposure in crash rates. This study presents a novel methodology for constructing dynamic human benchmarks that adjust for spatial and temporal variations in driving distribution between ADS and the overall human-driven fleet. Dynamic benchmarks were generated using human police-reported crash data, human vehicle miles traveled data, and over 20 million miles of operational data collected from an active ADS deployment across three U. S. counties. The spatial adjustment revealed significant differences across various severity levels in adjusted crash rates compared with unadjusted benchmarks with these differences ranging from 10% to 47% higher in San Francisco, 12% to 20% higher in Maricopa, and 7% lower to 34% higher in Los Angeles counties. The time-of-day adjustment in San Francisco, limited to this region because of data availability, resulted in adjusted crash rates 2% lower to 16% higher than unadjusted rates, depending on severity level. The findings underscore the importance of adjusting for spatial and temporal confounders in benchmarking analysis, which ultimately contributes to a more equitable benchmark for ADS performance evaluations.


  • Open Access

    RAVE checklist: Recommendations for overcoming challenges in retrospective safety studies of automated driving systems

    by John M. Scanlon, Eric R. Teoh, David G. Kidd, Kristofer D. Kusano, Jonas Bärgman, Geoffrey Chi-Johnston, Luigi Di Lillo, Francesca M. Favarò, Carol A. Flannagan, Henrik Liers, et al.

    The public, regulators, and domain experts alike seek to understand the effect of deployed SAE level 4 automated driving system (ADS) technologies on safety. The recent expansion of ADS technology deployments is paving the way for early stage safety impact evaluations, whereby the observational data from both an ADS and a representative benchmark fleet are compared to quantify safety performance. In January 2024; a working group of experts across academia, insurance, and industry came together in Washington, DC to discuss the current and future challenges in performing such evaluations. A subset of this working group then met, virtually, on multiple occasions to produce this paper. This paper presents the RAVE (Retrospective Automated Vehicle Evaluation) checklist, a set of fifteen recommendations for performing and evaluating retrospective ADS performance comparisons. The recommendations are centered around the concepts of (1) quality and validity, (2) transparency, and (3) interpretation. Over time, it is anticipated there will be a large and varied body of work evaluating the observed performance of these ADS fleets. Establishing and promoting good scientific practices benefits the work of stakeholders, many of whom may not be subject matter experts. This working group's intentions are to: i) strengthen individual research studies and ii) make the at-large community more informed on how to evaluate this collective body of work.


  • Open Access

    Benchmarks for retrospective automated driving system crash rate analysis using police-reported crash data

    by John M. Scanlon, Kristofer D. Kusano, Laura A. Fraade-Blanar, Timothy L. McMurry, Yin-Hsiu Chen, Trent Victor

    With fully automated driving systems (ADS; SAE level 4) ride-hailing services expanding in the U.S., we are now approaching an inflection point in the history of vehicle safety assessment. The process of retrospectively evaluating ADS safety impact (as seen with seatbelts, airbags, electronic stability control, etc.) can start to yield statistically credible conclusions. An ADS safety impact measurement requires a comparison to a "benchmark" crash rate. Most benchmarks generated to-date have focused on the current human-driven fleet, which enable researchers to understand the impact of the introduced ADS technology on the current crash record status quo. This study aims to address, update, and extend the existing literature by leveraging police-reported crashes to generate human crash rates for multiple geographic areas with current ADS deployments. Methods: All of the data leveraged is publicly accessible, and the benchmark determination methodology is intended to be repeatable and transparent. Generating a benchmark that is comparable to ADS crash data is associated with certain challenges, including data selection, handling underreporting and reporting thresholds, identifying the population of drivers and vehicles to compare against, choosing an appropriate severity level to assess, and matching crash and mileage exposure data. Consequently, we identify essential steps when generating benchmarks, and present our analyses amongst a backdrop of existing ADS benchmark literature. One analysis presented is the usage of established underreporting correction methodology to publicly available human driver police-reported data to improve comparability to publicly available ADS crash data. We also identified several important crash rate dependencies (geographic region, road type, and vehicle type), and show how failing to account for these features in ADS comparisons can bias results. Working with police-reported crash data to create crash rate benchmarks is fraught with challenges. Researchers should be cautious in their selection of crash rate benchmarks. We present these challenges, discuss their consequences, and provide analytical guidance for addressing them. This body of work aims to contribute to the ability of the community - researchers, regulators, industry, and experts - to reach consensus on how to estimate accurate benchmarks.


  • Top Cited Papers
    Open Access

    Comparison of Waymo rider-only crash data to human benchmarks at 7.1 million miles

    by Kristofer D. Kusano, John M. Scanlon, Yin-Hsiu Chen, Timothy L. McMurry, Ruoshu Chen, Tilia Gode, Trent Victor

    This article examines the safety performance of the Waymo Driver, an SAE level 4 automated driving system (ADS) used in a rider-only (RO) ride-hailing application without a human driver, either in the vehicle or remotely. ADS crash data were derived from NHTSA's Standing General Order (SGO) reporting over 7.14 million RO miles through the end of October 2023 in Phoenix, Arizona, San Francisco, California, and Los Angeles, California, and compared to human benchmarks from the literature. When considering all locations together, the any injury reported crashed vehicle rate was 0.6 incidents per million miles (IPMM) for the ADS vs. 2.80 IPMM for the human benchmark, an 80% reduction or a human crash rate that is 5 times higher than the ADS rate. Police-reported crashed vehicle rates for all locations together were 2.1 IPMM for the ADS vs. 4.68 IPMM for the human benchmark, a 55% reduction or a human crash rate that was 2.2 times higher than the ADS rate. Police-reported crashed vehicle rate reductions for the ADS were statistically significant when compared in San Francisco and Phoenix, as well as combined across all locations and the any-injury-reported reductions were statistically significant in San Francisco and in all locations. The any property damage or injury comparison had statistically significant decreases in 3 comparisons but also nonsignificant results in 3 other benchmarks. When excluding ADS crashes with a delta-V less than 1 mph (a measure of sensitivity to lower reporting threshold), about half of the ADS collisions were excluded, resulting in comparisons that showed a large statistically significant reduction in all comparisons except for one comparison from San Francisco. The statistically significant reductions in police-reported and any injury reported crash rates indicate a promising positive safety impact of ADS. The direction and significance of comparisons in the any property damage or injury outcome group are inconclusive due to difficulties in estimating a matching human benchmark. More research is needed on defining any property damage or injury benchmarks with clear lower reporting thresholds to reduce the systematic uncertainty in the benchmark rates. Together, these crash rate results contribute to the continuous growth in confidence, together with other methodologies, in a safety case approach.


  • Open Access

    Methodology for determining maximum injury potential for automated driving system evaluation

    by Kristofer Kusano, Trent Victor

    Scenario-based testing is being proposed as a method for evaluating the performance of an Automated Driving System (ADS). A scenario, in the driving context, is described as “a temporal sequence of...