Shunsuke Aoki
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Shunsuke Aoki has a total of 18 co-authors. Here are the top co-authors by number of shared publications:
Nobuo Kawaguchi
Graduate School of Engineering, Nagoya University, Aichi, Japan
3 shared publicationsTakuro Yonezawa
Graduate School of Engineering, Nagoya University, Aichi, Japan
3 shared publicationsRagunathan Rajkumar
Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
2 shared publications- Hitoshi Matsuyama
Nagoya University
1 shared publication Jin Nakazawa
Faculty of Environment, Information Studies, Keio University, Kanagawa, Japan
1 shared publication- Kaoru Sezaki
Institute of Industrial Science, The University of Tokyo, Meguro-ku, Tokyo, Japan
1 shared publication
Latest Publications
- 19 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 13 (4) , 2229-2237
ER-Chat: A Text-to-Text Open-Domain Dialogue Framework for Emotion Regulation
Emotions are essential for constructing social relationships between humans and interactive systems. Although emotional and empathetic dialogue generation methods have been proposed for dialogue systems, appropriate dialogue involves not only mirroring emotions and always being empathetic but also complex factors such as context. This paper proposes Emotion Regulation Chat (ER-Chat) as an end-to-end dialogue framework for emotion regulation. Emotion regulation is concerned with actions to approach appropriate emotional states. Learning appropriate emotion and intent when responding on the basis of the context of the dialogue enables the generation of more human-like dialogue. We conducted automatic and human evaluations to demonstrate the superiority of ER-Chat over the baseline system. The results show that inclusion of emotion and intent prediction mechanisms enable generation of dialogues with greater fluency, diversity, emotion awareness, and emotion appropriateness that are greatly preferred by humans.
- 19 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 13 (4) , 2229-2237
ER-Chat: A Text-to-Text Open-Domain Dialogue Framework for Emotion Regulation
Emotions are essential for constructing social relationships between humans and interactive systems. Although emotional and empathetic dialogue generation methods have been proposed for dialogue systems, appropriate dialogue involves not only mirroring emotions and always being empathetic but also complex factors such as context. This paper proposes Emotion Regulation Chat (ER-Chat) as an end-to-end dialogue framework for emotion regulation. Emotion regulation is concerned with actions to approach appropriate emotional states. Learning appropriate emotion and intent when responding on the basis of the context of the dialogue enables the generation of more human-like dialogue. We conducted automatic and human evaluations to demonstrate the superiority of ER-Chat over the baseline system. The results show that inclusion of emotion and intent prediction mechanisms enable generation of dialogues with greater fluency, diversity, emotion awareness, and emotion appropriateness that are greatly preferred by humans.
- Open Access
- 6 June 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of Vehicular Technology
- Vol. 3, 251-265
Safe Intersection Management With Cooperative Perception for Mixed Traffic of Human-Driven and Autonomous Vehicles
Autonomous driving systems are highly expected to be used on public roads to improve traffic throughput and road safety, but it will likely take a long transition period before all human-driven vehicles can be replaces with autonomous vehicles. Hence, CAVs have to safely cooperate with the surrounding human drivers, in order to gain the benefits of autonomous driving technologies during such transition periods. In this paper, we present a Distributed Synchronous Intersection Protocol (DSIP) and a Cooperative Perception-based High-Definition Map (CP-HD Map) for mixed traffic environments, in which autonomous vehicles co-exist with human-driven vehicles. First, in DSIP, each CAV utilizes dynamic decision-making mechanisms to adaptively change the vehicle behaviors based on the surrounding environments by using vehicle states and vehicle mode . In addition, in CP-HD Map, each CAV uses Vehicle-to-Vehicle (V2V) communications to share the information of detected objects to improve the road safety in the mixed traffic environments. Under these protocols, human-driven vehicles simply follow the traffic lights just like they do today. Finally, we show that DSIP and CP-HD Map increase the traffic throughput around the road intersections when we compared to existing signalized intersections and other V2V communications-based protocols.
- 6 June 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of Vehicular Technology
- Vol. 3, 251-265
Open AccessSafe Intersection Management With Cooperative Perception for Mixed Traffic of Human-Driven and Autonomous Vehicles
Autonomous driving systems are highly expected to be used on public roads to improve traffic throughput and road safety, but it will likely take a long transition period before all human-driven vehicles can be replaces with autonomous vehicles. Hence, CAVs have to safely cooperate with the surrounding human drivers, in order to gain the benefits of autonomous driving technologies during such transition periods. In this paper, we present a Distributed Synchronous Intersection Protocol (DSIP) and a Cooperative Perception-based High-Definition Map (CP-HD Map) for mixed traffic environments, in which autonomous vehicles co-exist with human-driven vehicles. First, in DSIP, each CAV utilizes dynamic decision-making mechanisms to adaptively change the vehicle behaviors based on the surrounding environments by using vehicle states and vehicle mode . In addition, in CP-HD Map, each CAV uses Vehicle-to-Vehicle (V2V) communications to share the information of detected objects to improve the road safety in the mixed traffic environments. Under these protocols, human-driven vehicles simply follow the traffic lights just like they do today. Finally, we show that DSIP and CP-HD Map increase the traffic throughput around the road intersections when we compared to existing signalized intersections and other V2V communications-based protocols.
- Open Access
A-DRIVE: Autonomous Deadlock Detection and Recovery at Road Intersections for Connected and Automated Vehicles
Connected and Automated Vehicles (CAVs) are highly expected to improve traffic throughput and safety at road intersections, single-track lanes, and construction zones. However, multiple CAVs can block each other and create a mutual deadlock around these road segments (i) when vehicle systems have a failure, such as a communication failure, control failure, or localization failure and/or (ii) when vehicles use a long shared road segment. In this paper, we present an Autonomous Deadlock Detection and Recovery Protocol at Intersections for Automated Vehicles named A-DRIVE that is a decentralized and time-sensitive technique to improve traffic throughput and shorten worst-case recovery time. To enable the deadlock recovery with automated vehicles and with human-driven vehicles, A-DRIVE includes two components: V2V communication-based A-DRIVE and Local perception-based A-DRIVE. V2V communication-based A-DRIVE is designed for homogeneous traffic environments in which all the vehicles are connected and automated. Local perception-based A-DRIVE is for mixed traffic, where CAVs, non-connected automated vehicles, and human-driven vehicles co-exist and cooperate with one another. Since these two components are not exclusive, CAVs inclusively and seamlessly use them in practice. Finally, our simulation results show that A-DRIVE improves traffic throughput compared to a baseline protocol.
Open AccessA-DRIVE: Autonomous Deadlock Detection and Recovery at Road Intersections for Connected and Automated Vehicles
Connected and Automated Vehicles (CAVs) are highly expected to improve traffic throughput and safety at road intersections, single-track lanes, and construction zones. However, multiple CAVs can block each other and create a mutual deadlock around these road segments (i) when vehicle systems have a failure, such as a communication failure, control failure, or localization failure and/or (ii) when vehicles use a long shared road segment. In this paper, we present an Autonomous Deadlock Detection and Recovery Protocol at Intersections for Automated Vehicles named A-DRIVE that is a decentralized and time-sensitive technique to improve traffic throughput and shorten worst-case recovery time. To enable the deadlock recovery with automated vehicles and with human-driven vehicles, A-DRIVE includes two components: V2V communication-based A-DRIVE and Local perception-based A-DRIVE. V2V communication-based A-DRIVE is designed for homogeneous traffic environments in which all the vehicles are connected and automated. Local perception-based A-DRIVE is for mixed traffic, where CAVs, non-connected automated vehicles, and human-driven vehicles co-exist and cooperate with one another. Since these two components are not exclusive, CAVs inclusively and seamlessly use them in practice. Finally, our simulation results show that A-DRIVE improves traffic throughput compared to a baseline protocol.
- 8 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 23 (11) , 22519-22534
Cyber Traffic Light: Safe Cooperation for Autonomous Vehicles at Dynamic Intersections
Autonomous driving systems are becoming increasingly feasible and highly expected to be the heart of intelligent transportation systems. To deploy the autonomous driving vehicles on public roads, one of the practical challenges might be safe cooperation and collaboration among multiple vehicles, in particular when conflicts arise on shared road segments, such as road intersections, merge points, construction zones, single-track lanes, and center turn lane. In the current traffic systems, human drivers navigate these regions using a combination of traffic rules, social norms, courtesy, hand signals, and common sense. In this paper, we identify and classify such Dynamic Intersections that might lead to vehicle accidents and/or deadlocks and that might appear almost anytime and anywhere on public roads. In addition, we present a cooperative dynamic intersection protocol that uses on-board perception systems and vehicular communications for peer-to-peer negotiation. Under our protocol, autonomous driving vehicles can create a vehicular communication-based traffic manager named Cyber Traffic Light when congestion arises. Cyber Traffic Light works as a self-organizing, self-planning, and self-optimizing traffic manager, and it allocates the green period for vehicles coming from the multiple directions. Finally, we showed that our decentralized protocol has much higher traffic throughput, compared to two simple protocols while guaranteeing road safety.
- 8 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 23 (11) , 22519-22534
Cyber Traffic Light: Safe Cooperation for Autonomous Vehicles at Dynamic Intersections
Autonomous driving systems are becoming increasingly feasible and highly expected to be the heart of intelligent transportation systems. To deploy the autonomous driving vehicles on public roads, one of the practical challenges might be safe cooperation and collaboration among multiple vehicles, in particular when conflicts arise on shared road segments, such as road intersections, merge points, construction zones, single-track lanes, and center turn lane. In the current traffic systems, human drivers navigate these regions using a combination of traffic rules, social norms, courtesy, hand signals, and common sense. In this paper, we identify and classify such Dynamic Intersections that might lead to vehicle accidents and/or deadlocks and that might appear almost anytime and anywhere on public roads. In addition, we present a cooperative dynamic intersection protocol that uses on-board perception systems and vehicular communications for peer-to-peer negotiation. Under our protocol, autonomous driving vehicles can create a vehicular communication-based traffic manager named Cyber Traffic Light when congestion arises. Cyber Traffic Light works as a self-organizing, self-planning, and self-optimizing traffic manager, and it allocates the green period for vehicles coming from the multiple directions. Finally, we showed that our decentralized protocol has much higher traffic throughput, compared to two simple protocols while guaranteeing road safety.
- 3 January 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Letters
- Vol. 6 (2) , 1-4
RobotNEST: Toward a Viable Testbed for IoT-Enabled Environments and Connected and Autonomous Robots
Autonomous mobile robots (AMRs), including delivery robots, security robots, and automated wheelchairs, are very promising for improving the quality of life, safety, mobility, and productivity. To deploy such sensor-rich AMRs in real-world society, we have to resolve not only technical challenges but also ethical and societal issues. In addition, since multiple companies are developing different types of AMRs individually, we have to design and develop practical platform to enable safe cooperation and collaboration before using them in the society. Hence, in this letter, we present a viable Nagoya Experimental Site and Testbed named RobotNEST developed at Nagoya City, Japan, where we leverage vehicular communications and edge/cloud computing technologies to develop cooperative mobile robots. RobotNEST provides real-world AMRs, experimental fields, learning kits, and infrastructural sensors and communications, including 5G private networks. We also introduce multiple developed applications at RobotNEST that enable safe cooperation for autonomous robots. Finally, we discuss the scalability and limitations of the testbed and conclude with future research directions.
- 3 January 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Letters
- Vol. 6 (2) , 1-4
RobotNEST: Toward a Viable Testbed for IoT-Enabled Environments and Connected and Autonomous Robots
Autonomous mobile robots (AMRs), including delivery robots, security robots, and automated wheelchairs, are very promising for improving the quality of life, safety, mobility, and productivity. To deploy such sensor-rich AMRs in real-world society, we have to resolve not only technical challenges but also ethical and societal issues. In addition, since multiple companies are developing different types of AMRs individually, we have to design and develop practical platform to enable safe cooperation and collaboration before using them in the society. Hence, in this letter, we present a viable Nagoya Experimental Site and Testbed named RobotNEST developed at Nagoya City, Japan, where we leverage vehicular communications and edge/cloud computing technologies to develop cooperative mobile robots. RobotNEST provides real-world AMRs, experimental fields, learning kits, and infrastructural sensors and communications, including 5G private networks. We also introduce multiple developed applications at RobotNEST that enable safe cooperation for autonomous robots. Finally, we discuss the scalability and limitations of the testbed and conclude with future research directions.
- 1 January 2022
- Published by Springer Nature
- p. 553-567
Synthetic People Flow: Privacy-Preserving Mobility Modeling from Large-Scale Location Data in Urban Areas
- 1 January 2022
- Published by Springer Nature
- p. 553-567
Synthetic People Flow: Privacy-Preserving Mobility Modeling from Large-Scale Location Data in Urban Areas
- 21 July 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 21 (22) , 25437-25448
Deep Learning for Ballroom Dance Recognition: A Temporal and Trajectory-Aware Classification Model With Three-Dimensional Pose Estimation and Wearable Sensing
Dance performance recognition methods have been investigated and shown various applications such as picture-pose evaluation and synchronizing foot timing and direction. However, detailed analysis and feedback are still missing. To provide them, understanding the performance by component level is necessary. Specifically, we formulate it as a dance-figure classification problem using three-dimensional body joints and wearable sensors. Our model is based on long short-term memory (LSTM) and includes the temporal and trajectory-wise structure that uses the trajectory information in a timestep and the temporal masking module. As a result, we achieved 93% accuracy with our proposed method, which is highly overwhelming the baseline result (84.7%) and very close to the accuracy of the experienced dancers (93.6%). We have made the dataset of ballroom dance performance dataset open to researchers to develop the activity recognition field further.
- 21 July 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 21 (22) , 25437-25448
Deep Learning for Ballroom Dance Recognition: A Temporal and Trajectory-Aware Classification Model With Three-Dimensional Pose Estimation and Wearable Sensing
Dance performance recognition methods have been investigated and shown various applications such as picture-pose evaluation and synchronizing foot timing and direction. However, detailed analysis and feedback are still missing. To provide them, understanding the performance by component level is necessary. Specifically, we formulate it as a dance-figure classification problem using three-dimensional body joints and wearable sensors. Our model is based on long short-term memory (LSTM) and includes the temporal and trajectory-wise structure that uses the trajectory information in a timestep and the temporal masking module. As a result, we achieved 93% accuracy with our proposed method, which is highly overwhelming the baseline result (84.7%) and very close to the accuracy of the experienced dancers (93.6%). We have made the dataset of ballroom dance performance dataset open to researchers to develop the activity recognition field further.
- 28 September 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Big Data
- Vol. 7 (2) , 371-382
BusBeat: Early Event Detection with Real-Time Bus GPS Trajectories
Large-scale events attracting many participants might have a strong negative impact on productivity, mobility, comfort, and safety in a city. Within the few years, serious accidents led by congestion have occurred, especially during sports events, religious ceremonies, festivals, and so on. To alleviate these serious accidents, predicting the occurrence of a large-scale event is much significant. When we know an event occurrence in advance, some of those who are not interested in the event might change their plans and/or might take a detour to avoid to get involved in a heavy congestion. In this paper, we present an early event detection technique named BusBeat. BusBeat uses GPS trajectory data collected from periodic-cars that are vehicles periodically traveling on a pre-scheduled route with a pre-determined departure time, such as a transit bus, shuttle, garbage truck, or municipal patrol car. BusBeat interpolates the missing GPS data by using the features of the periodic-cars. In addition, BusBeat uses the network-based analysis with a Time-dependent Congestion Network (TCN) in order to detect geo-spatial events. BusBeat achieves early event detection without incurring any privacy invasion, by using the continuous trajectories of the periodic-cars that provide the real-time traffic flow and speed. Since traffic towards an event venue would be slow before the event starts, BusBeat detects the geo-spatial events before the attendees gather. We evaluate our BusBeat using over 7,000-bus data collected in Beijing for 5 months and compare with the check-in data collected from a social network service.
- 28 September 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Big Data
- Vol. 7 (2) , 371-382
BusBeat: Early Event Detection with Real-Time Bus GPS Trajectories
Large-scale events attracting many participants might have a strong negative impact on productivity, mobility, comfort, and safety in a city. Within the few years, serious accidents led by congestion have occurred, especially during sports events, religious ceremonies, festivals, and so on. To alleviate these serious accidents, predicting the occurrence of a large-scale event is much significant. When we know an event occurrence in advance, some of those who are not interested in the event might change their plans and/or might take a detour to avoid to get involved in a heavy congestion. In this paper, we present an early event detection technique named BusBeat. BusBeat uses GPS trajectory data collected from periodic-cars that are vehicles periodically traveling on a pre-scheduled route with a pre-determined departure time, such as a transit bus, shuttle, garbage truck, or municipal patrol car. BusBeat interpolates the missing GPS data by using the features of the periodic-cars. In addition, BusBeat uses the network-based analysis with a Time-dependent Congestion Network (TCN) in order to detect geo-spatial events. BusBeat achieves early event detection without incurring any privacy invasion, by using the continuous trajectories of the periodic-cars that provide the real-time traffic flow and speed. Since traffic towards an event venue would be slow before the event starts, BusBeat detects the geo-spatial events before the attendees gather. We evaluate our BusBeat using over 7,000-bus data collected in Beijing for 5 months and compare with the check-in data collected from a social network service.