Jaein Song
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Jaein Song has a total of 14 co-authors. Here are the top co-authors by number of shared publications:
- Minhee Kang
Korea Advanced Institute of Science and Technology
8 shared publications - Keeyeon Hwang
The Department of Urban Planning, Hongik University, Seoul 04066, Korea
6 shared publications - Hojun Lee
Department of Urban Design & Planning, Hongik University, Seoul 04066, Korea
1 shared publication - Hojun Lee
SpaceInsight Company Ltd., Seoul, South Korea
1 shared publication I-Jeong Im
1 shared publication- I-Jeong Im
Transport Service Team, Korea Autonomous Driving Development Innovation Foundation, Seoul 06710, Korea
1 shared publication
Latest Publications
- Open Access
- 29 October 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 159670-159687
Auto-Scenario Generator for Autonomous Vehicle Safety: Multi-Modal Attention-Based Image Captioning Model Using Digital Twin Data
The field of autonomous vehicles (AVs) scenarios has become a more vital process to secure safety. However, the existing scenario approaches to assess AVs have three limitations: low representativeness, low diversity, and low efficiency. Since the real AV driving data cannot be accessed publicly, the scenarios based on low-dimensional data are inadequate to secure representativeness and diversity. Also, generating myriad scenarios using human resources (numerous experts’ input) is inefficient and often lacks consistency. Recognizing these issues, we present a novel approach for generating scenarios of AVs safety. Our approach emphasizes process efficiency in generating scenarios while ensuring diversity and representativeness. We devise a multi-modal image captioning model, referred to as Auto Scenario Generator (Auto-SG), which automatically generates accident scenarios using digital twin data. This model consists of inception-v3, attention mechanism, and GRU. Using SCANeR studio, we also implement various AV accident situations and extract the images for model training. We identify the optimal Auto-SG model through extensive experimentation, enabling the model to generate captions similar to real captions. To evaluate the model, we use BLEU@N and ROUGE-L metrics. Our model achieves approximately 80 to higher scores, demonstrating that the captions of AV accident scenarios are generated correctly. Among the results, we exemplify six top-accuracy accidents as to formalized functional scenarios for assessing AV safety. The scenarios present two intersections and four road-related accidents, including the behaviors of lane changing and turning right. Finally, we suggest the qualitative criterion of ’efficiency’ to evaluate these scenarios, which can consider investments of human resources and consistency of scenarios. We believe our model can help us generate scenarios more efficiently while ensuring diversity and representativeness.
- 29 October 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 159670-159687
Open AccessAuto-Scenario Generator for Autonomous Vehicle Safety: Multi-Modal Attention-Based Image Captioning Model Using Digital Twin Data
The field of autonomous vehicles (AVs) scenarios has become a more vital process to secure safety. However, the existing scenario approaches to assess AVs have three limitations: low representativeness, low diversity, and low efficiency. Since the real AV driving data cannot be accessed publicly, the scenarios based on low-dimensional data are inadequate to secure representativeness and diversity. Also, generating myriad scenarios using human resources (numerous experts’ input) is inefficient and often lacks consistency. Recognizing these issues, we present a novel approach for generating scenarios of AVs safety. Our approach emphasizes process efficiency in generating scenarios while ensuring diversity and representativeness. We devise a multi-modal image captioning model, referred to as Auto Scenario Generator (Auto-SG), which automatically generates accident scenarios using digital twin data. This model consists of inception-v3, attention mechanism, and GRU. Using SCANeR studio, we also implement various AV accident situations and extract the images for model training. We identify the optimal Auto-SG model through extensive experimentation, enabling the model to generate captions similar to real captions. To evaluate the model, we use BLEU@N and ROUGE-L metrics. Our model achieves approximately 80 to higher scores, demonstrating that the captions of AV accident scenarios are generated correctly. Among the results, we exemplify six top-accuracy accidents as to formalized functional scenarios for assessing AV safety. The scenarios present two intersections and four road-related accidents, including the behaviors of lane changing and turning right. Finally, we suggest the qualitative criterion of ’efficiency’ to evaluate these scenarios, which can consider investments of human resources and consistency of scenarios. We believe our model can help us generate scenarios more efficiently while ensuring diversity and representativeness.
- Open Access
- 14 September 2022
- Published by MDPI AG in Sustainability
- Vol. 14 (18) , 11490
Is Only the Dedicated Lane for Automated Vehicles Essential in the Future? The Dedicated Lanes Optimal Operating System Evaluation
As new mobility called automated vehicles (AVs) appears on the road, positive effects are expected, but in fact, unexpected adverse effects may arise due to the mixed traffic situation with human-driven vehicles (HVs). Prior to the commercialization of AVs, a preliminary review and preventive measures are required, and among them, the interaction between the existing vehicle and the new mobility and the interaction with the infrastructure must be considered. Therefore, we propose (i) the positive–negative effect of introducing AVs in a mixed traffic situation and (ii) the optimal operation plan for the dedicated lane for AVs. First, the effect of introducing AVs considering the interaction between vehicles in the mixed traffic situation showed mostly positive such as speed increase, delay time reduction, and capacity increase. However, in a 75% Market Penetration Rate (MPR) environment of all levels of Service (LOS), the effect was diminished compared to the previous MPR. This is contemplated to be the result of a conflict caused by the operation of some HVs (including heavy vehicles) behavior as obstacles in the situation where most of the vehicles on the road are AVs. Based on the previous result, we deployed the dedicated lane to resolve the negative effect in the 75% MPR environment and proposed an optimal operation strategy for the AVs dedicated lane from the perspective of operational efficiency for a more feasible operation. Given the 75% MPR, the Mixed-Use operation strategy of High-Occupancy Vehicles (HOV) and AVs is ascertained as the most suitable operation strategy. This implies that even in the era of AVs, the influence of other vehicles (e.g., heavy vehicles, other mobility) must be considered. This study is significant by considering the negative effects of the introduction of AVs and presenting an optimal operation strategy for dedicated lanes, and it can expect to be used as a new strategy as part of the Free/Expressway Traffic Management System (FTMS) applicable in the era of autonomous driving.
- 14 September 2022
- Published by MDPI AG in Sustainability
- Vol. 14 (18) , 11490
Open AccessIs Only the Dedicated Lane for Automated Vehicles Essential in the Future? The Dedicated Lanes Optimal Operating System Evaluation
As new mobility called automated vehicles (AVs) appears on the road, positive effects are expected, but in fact, unexpected adverse effects may arise due to the mixed traffic situation with human-driven vehicles (HVs). Prior to the commercialization of AVs, a preliminary review and preventive measures are required, and among them, the interaction between the existing vehicle and the new mobility and the interaction with the infrastructure must be considered. Therefore, we propose (i) the positive–negative effect of introducing AVs in a mixed traffic situation and (ii) the optimal operation plan for the dedicated lane for AVs. First, the effect of introducing AVs considering the interaction between vehicles in the mixed traffic situation showed mostly positive such as speed increase, delay time reduction, and capacity increase. However, in a 75% Market Penetration Rate (MPR) environment of all levels of Service (LOS), the effect was diminished compared to the previous MPR. This is contemplated to be the result of a conflict caused by the operation of some HVs (including heavy vehicles) behavior as obstacles in the situation where most of the vehicles on the road are AVs. Based on the previous result, we deployed the dedicated lane to resolve the negative effect in the 75% MPR environment and proposed an optimal operation strategy for the AVs dedicated lane from the perspective of operational efficiency for a more feasible operation. Given the 75% MPR, the Mixed-Use operation strategy of High-Occupancy Vehicles (HOV) and AVs is ascertained as the most suitable operation strategy. This implies that even in the era of AVs, the influence of other vehicles (e.g., heavy vehicles, other mobility) must be considered. This study is significant by considering the negative effects of the introduction of AVs and presenting an optimal operation strategy for dedicated lanes, and it can expect to be used as a new strategy as part of the Free/Expressway Traffic Management System (FTMS) applicable in the era of autonomous driving.
- 1 July 2022
- Published by Springer Nature
- p. 1-15
The Extraction of Automated Vehicles Traffic Accident Factors and Scenarios Using Real-World Data
- 1 July 2022
- Published by Springer Nature
- p. 1-15
The Extraction of Automated Vehicles Traffic Accident Factors and Scenarios Using Real-World Data
- Open Access
- 20 August 2021
- Published by MDPI AG in Sustainability
- Vol. 13 (16) , 9351
An Application of a Deep Q-Network Based Dynamic Fare Bidding System to Improve the Use of Taxi Services during Off-Peak Hours in Seoul
The problem of structural imbalance in terms of supply and demand due to changes in traffic patterns by time zone has been continuously raised in the mobility market. In Korea, unlike large overseas cities, the waiting time tolerance increases during the daytime when supply far exceeds demand, resulting in a large loss of operating profit. The purpose of this study is to increase taxi demand and further improve driver’s profits through real-time fare discounts during off-peak daytime hours in Seoul, Korea. To this end, we propose a real-time fare bidding system among taxi drivers based on a dynamic pricing scheme and simulate the appropriate fare discount level for each regional time zone. The driver-to-driver fare competition system consists of simulating fare competition based on the multi-agent Deep Q-Network method after developing a fare discount index that reflects the supply and demand level of each region in 25 districts in Seoul. According to the optimal fare discount level analysis in the off-peak hours, the lower the OI Index, which means the level of demand relative to supply, the higher the fare discount rate. In addition, an analysis of drivers’ profits and matching rates according to the distance between the origin and destination of each region showed up to 89% and 65% of drivers who actively offered discounts on fares. The results of this study in the future can serve as the foundation of a fare adjustment system for varying demand and supply situations in the Korean mobility market.
- 20 August 2021
- Published by MDPI AG in Sustainability
- Vol. 13 (16) , 9351
Open AccessAn Application of a Deep Q-Network Based Dynamic Fare Bidding System to Improve the Use of Taxi Services during Off-Peak Hours in Seoul
The problem of structural imbalance in terms of supply and demand due to changes in traffic patterns by time zone has been continuously raised in the mobility market. In Korea, unlike large overseas cities, the waiting time tolerance increases during the daytime when supply far exceeds demand, resulting in a large loss of operating profit. The purpose of this study is to increase taxi demand and further improve driver’s profits through real-time fare discounts during off-peak daytime hours in Seoul, Korea. To this end, we propose a real-time fare bidding system among taxi drivers based on a dynamic pricing scheme and simulate the appropriate fare discount level for each regional time zone. The driver-to-driver fare competition system consists of simulating fare competition based on the multi-agent Deep Q-Network method after developing a fare discount index that reflects the supply and demand level of each region in 25 districts in Seoul. According to the optimal fare discount level analysis in the off-peak hours, the lower the OI Index, which means the level of demand relative to supply, the higher the fare discount rate. In addition, an analysis of drivers’ profits and matching rates according to the distance between the origin and destination of each region showed up to 89% and 65% of drivers who actively offered discounts on fares. The results of this study in the future can serve as the foundation of a fare adjustment system for varying demand and supply situations in the Korean mobility market.
- Open Access
- 19 July 2021
- Published by MDPI AG in Electronics
- Vol. 10 (14) , 1737
The Design of Preventive Automated Driving Systems Based on Convolutional Neural Network
As automated vehicles have been considered one of the important trends in intelligent transportation systems, various research is being conducted to enhance their safety. In particular, the importance of technologies for the design of preventive automated driving systems, such as detection of surrounding objects and estimation of distance between vehicles. Object detection is mainly performed through cameras and LiDAR, but due to the cost and limits of LiDAR’s recognition distance, the need to improve Camera recognition technique, which is relatively convenient for commercialization, is increasing. This study learned convolutional neural network (CNN)-based faster regions with CNN (Faster R-CNN) and You Only Look Once (YOLO) V2 to improve the recognition techniques of vehicle-mounted monocular cameras for the design of preventive automated driving systems, recognizing surrounding vehicles in black box highway driving videos and estimating distances from surrounding vehicles through more suitable models for automated driving systems. Moreover, we learned the PASCAL visual object classes (VOC) dataset for model comparison. Faster R-CNN showed similar accuracy, with a mean average precision (mAP) of 76.4 to YOLO with a mAP of 78.6, but with a Frame Per Second (FPS) of 5, showing slower processing speed than YOLO V2 with an FPS of 40, and a Faster R-CNN, which we had difficulty detecting. As a result, YOLO V2, which shows better performance in accuracy and processing speed, was determined to be a more suitable model for automated driving systems, further progressing in estimating the distance between vehicles. For distance estimation, we conducted coordinate value conversion through camera calibration and perspective transform, set the threshold to 0.7, and performed object detection and distance estimation, showing more than 80% accuracy for near-distance vehicles. Through this study, it is believed that it will be able to help prevent accidents in automated vehicles, and it is expected that additional research will provide various accident prevention alternatives such as calculating and securing appropriate safety distances, depending on the vehicle types.
- 19 July 2021
- Published by MDPI AG in Electronics
- Vol. 10 (14) , 1737
Open AccessThe Design of Preventive Automated Driving Systems Based on Convolutional Neural Network
As automated vehicles have been considered one of the important trends in intelligent transportation systems, various research is being conducted to enhance their safety. In particular, the importance of technologies for the design of preventive automated driving systems, such as detection of surrounding objects and estimation of distance between vehicles. Object detection is mainly performed through cameras and LiDAR, but due to the cost and limits of LiDAR’s recognition distance, the need to improve Camera recognition technique, which is relatively convenient for commercialization, is increasing. This study learned convolutional neural network (CNN)-based faster regions with CNN (Faster R-CNN) and You Only Look Once (YOLO) V2 to improve the recognition techniques of vehicle-mounted monocular cameras for the design of preventive automated driving systems, recognizing surrounding vehicles in black box highway driving videos and estimating distances from surrounding vehicles through more suitable models for automated driving systems. Moreover, we learned the PASCAL visual object classes (VOC) dataset for model comparison. Faster R-CNN showed similar accuracy, with a mean average precision (mAP) of 76.4 to YOLO with a mAP of 78.6, but with a Frame Per Second (FPS) of 5, showing slower processing speed than YOLO V2 with an FPS of 40, and a Faster R-CNN, which we had difficulty detecting. As a result, YOLO V2, which shows better performance in accuracy and processing speed, was determined to be a more suitable model for automated driving systems, further progressing in estimating the distance between vehicles. For distance estimation, we conducted coordinate value conversion through camera calibration and perspective transform, set the threshold to 0.7, and performed object detection and distance estimation, showing more than 80% accuracy for near-distance vehicles. Through this study, it is believed that it will be able to help prevent accidents in automated vehicles, and it is expected that additional research will provide various accident prevention alternatives such as calculating and securing appropriate safety distances, depending on the vehicle types.
- Open Access
- 18 December 2020
- Published by MDPI AG in Electronics
- Vol. 9 (12) , 2178
The Detection of Black Ice Accidents for Preventative Automated Vehicles Using Convolutional Neural Networks
Automated Vehicles (AVs) are expected to dramatically reduce traffic accidents that have occurred when using human driving vehicles (HVs). However, despite the rapid development of AVs, accidents involving AVs can occur even in ideal situations. Therefore, in order to enhance their safety, “preventive design” for accidents is continuously required. Accordingly, the “preventive design” that prevents accidents in advance is continuously required to enhance the safety of AVs. Specially, black ice with characteristics that are difficult to identify with the naked eye—the main cause of major accidents in winter vehicles—is expected to cause serious injuries in the era of AVs, and measures are needed to prevent them. Therefore, this study presents a Convolutional Neural Network (CNN)-based black ice detection plan to prevent traffic accidents of AVs caused by black ice. Due to the characteristic of black ice that is formed only in a certain environment, we augmented image data and learned road environment images. Tests showed that the proposed CNN model detected black ice with 96% accuracy and reproducibility. It is expected that the CNN model for black ice detection proposed in this study will contribute to improving the safety of AVs and prevent black ice accidents in advance.
- 18 December 2020
- Published by MDPI AG in Electronics
- Vol. 9 (12) , 2178
Open AccessThe Detection of Black Ice Accidents for Preventative Automated Vehicles Using Convolutional Neural Networks
Automated Vehicles (AVs) are expected to dramatically reduce traffic accidents that have occurred when using human driving vehicles (HVs). However, despite the rapid development of AVs, accidents involving AVs can occur even in ideal situations. Therefore, in order to enhance their safety, “preventive design” for accidents is continuously required. Accordingly, the “preventive design” that prevents accidents in advance is continuously required to enhance the safety of AVs. Specially, black ice with characteristics that are difficult to identify with the naked eye—the main cause of major accidents in winter vehicles—is expected to cause serious injuries in the era of AVs, and measures are needed to prevent them. Therefore, this study presents a Convolutional Neural Network (CNN)-based black ice detection plan to prevent traffic accidents of AVs caused by black ice. Due to the characteristic of black ice that is formed only in a certain environment, we augmented image data and learned road environment images. Tests showed that the proposed CNN model detected black ice with 96% accuracy and reproducibility. It is expected that the CNN model for black ice detection proposed in this study will contribute to improving the safety of AVs and prevent black ice accidents in advance.
- Open Access
- 2 November 2020
- Published by MDPI AG in Electronics
- Vol. 9 (11) , 1829
For Preventative Automated Driving System (PADS): Traffic Accident Context Analysis Based on Deep Neural Networks
Automated Vehicles (AVs) are under development to reduce traffic accidents to a great extent. Therefore, safety will play a pivotal role to determine their social acceptability. Despite the fast development of AVs technologies, related accidents can occur even in an ideal environment. Therefore, measures to prevent traffic accidents in advance are essential. This study implemented a traffic accident context analysis based on the Deep Neural Network (DNNs) technique to design a Preventive Automated Driving System (PADS). The DNN-based analysis reveals that when a traffic accident occurs, the offender’s injury can be predicted with 85% accuracy and the victim’s case with 67%. In addition, to find out factors that decide the degree of injury to the offender and victim, a random forest analysis was implemented. The vehicle type and speed were identified as the most important factors to decide the degree of injury of the offender, while the importance for the victim is ordered by speed, time of day, vehicle type, and day of the week. The PADS proposed in this study is expected not only to contribute to improve the safety of AVs, but to prevent accidents in advance.
- 2 November 2020
- Published by MDPI AG in Electronics
- Vol. 9 (11) , 1829
Open AccessFor Preventative Automated Driving System (PADS): Traffic Accident Context Analysis Based on Deep Neural Networks
Automated Vehicles (AVs) are under development to reduce traffic accidents to a great extent. Therefore, safety will play a pivotal role to determine their social acceptability. Despite the fast development of AVs technologies, related accidents can occur even in an ideal environment. Therefore, measures to prevent traffic accidents in advance are essential. This study implemented a traffic accident context analysis based on the Deep Neural Network (DNNs) technique to design a Preventive Automated Driving System (PADS). The DNN-based analysis reveals that when a traffic accident occurs, the offender’s injury can be predicted with 85% accuracy and the victim’s case with 67%. In addition, to find out factors that decide the degree of injury to the offender and victim, a random forest analysis was implemented. The vehicle type and speed were identified as the most important factors to decide the degree of injury of the offender, while the importance for the victim is ordered by speed, time of day, vehicle type, and day of the week. The PADS proposed in this study is expected not only to contribute to improve the safety of AVs, but to prevent accidents in advance.
- Open Access
- 2 November 2020
- Published by MDPI AG in Electronics
- Vol. 9 (11) , 1818
An Application of Reinforced Learning-Based Dynamic Pricing for Improvement of Ridesharing Platform Service in Seoul
As ridesharing services (including taxi) are often run by private companies, profitability is the top priority in operation. This leads to an increase in the driver’s refusal to take passengers to areas with low demand where they will have difficulties finding subsequent passengers, causing problems such as an extended waiting time when hailing a vehicle for passengers bound for these regions. The study used Seoul’s taxi data to find appropriate surge rates of ridesharing services between 10:00 p.m. and 4:00 a.m. by region using a reinforcement learning algorithm to resolve this problem during the worst time period. In reinforcement learning, the outcome of centrality analysis was applied as a weight affecting drivers’ destination choice probability. Furthermore, the reward function used in the learning was adjusted according to whether the passenger waiting time value was applied or not. The profit was used for reward value. By using a negative reward for the passenger waiting time, the study was able to identify a more appropriate surge level. Across the region, the surge averaged a value of 1.6. To be more specific, those located on the outskirts of the city and in residential areas showed a higher surge, while central areas had a lower surge. Due to this different surge, a driver’s refusal to take passengers can be lessened and the passenger waiting time can be shortened. The supply of ridesharing services in low-demand regions can be increased by as much as 7.5%, allowing regional equity problems related to ridesharing services in Seoul to be reduced to a greater extent.
- 2 November 2020
- Published by MDPI AG in Electronics
- Vol. 9 (11) , 1818
Open AccessAn Application of Reinforced Learning-Based Dynamic Pricing for Improvement of Ridesharing Platform Service in Seoul
As ridesharing services (including taxi) are often run by private companies, profitability is the top priority in operation. This leads to an increase in the driver’s refusal to take passengers to areas with low demand where they will have difficulties finding subsequent passengers, causing problems such as an extended waiting time when hailing a vehicle for passengers bound for these regions. The study used Seoul’s taxi data to find appropriate surge rates of ridesharing services between 10:00 p.m. and 4:00 a.m. by region using a reinforcement learning algorithm to resolve this problem during the worst time period. In reinforcement learning, the outcome of centrality analysis was applied as a weight affecting drivers’ destination choice probability. Furthermore, the reward function used in the learning was adjusted according to whether the passenger waiting time value was applied or not. The profit was used for reward value. By using a negative reward for the passenger waiting time, the study was able to identify a more appropriate surge level. Across the region, the surge averaged a value of 1.6. To be more specific, those located on the outskirts of the city and in residential areas showed a higher surge, while central areas had a lower surge. Due to this different surge, a driver’s refusal to take passengers can be lessened and the passenger waiting time can be shortened. The supply of ridesharing services in low-demand regions can be increased by as much as 7.5%, allowing regional equity problems related to ridesharing services in Seoul to be reduced to a greater extent.
- 28 February 2020
- Published by The Korea Institute of Intelligent Transport Systems in The Journal of The Korea Institute of Intelligent Transport Systems
- Vol. 19 (1) , 107-120
An Importance Analysis of The Korean Ethical Guideline for Automated Vehicle Using AHP Method
- 28 February 2020
- Published by The Korea Institute of Intelligent Transport Systems in The Journal of The Korea Institute of Intelligent Transport Systems
- Vol. 19 (1) , 107-120
An Importance Analysis of The Korean Ethical Guideline for Automated Vehicle Using AHP Method