Yu Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Yu Liu has a total of 7 co-authors. Here are the top co-authors by number of shared publications:
- Na Du
School of Computing and Information, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
2 shared publications - Lesong Jia
School of Computing and Information, University of Pittsburgh
1 shared publication - Makayla Chang
University of Pittsburgh, Pittsburgh, Pennsylvania, USA
1 shared publication - Shihong Ling
Department of Informatics and Networked Systems, School of Computing and Information, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
1 shared publication - Xiaowei Jia
Rutgers University, New Brunswick, NJ, USA
1 shared publication - Yaohan Ding
University of Pittsburgh, PA, USA
1 shared publication
Latest Publications
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-20
When to Explain: Modeling User Need for Explanations in Real-World Autonomous Driving
The integration of artificial intelligence into autonomous vehicles (AVs) raises transparency challenges that can hinder user acceptance and experience. To address when users need AV explanations, we created a large-scale dataset of 3327 diverse driving scenarios, each paired with a user-friendly explanation, and conducted an online study to survey when users need explanations. Using both scenario and user-related factors, our best-performing tree-ensemble models predicted explanation need with great performance (F1=0.72, AUC=0.82). SHAP analyses revealed that while both user- and scenario-related factors matter, factors directly related to driving (AV driving style, AV action, event cause, annual mileage, human driving style) were more contributive than general demographics and environmental factors. Our study delivers a comprehensively annotated dataset that underpins future human-AV interaction research, an explainable model that reliably predicts explanation needs, and valuable insights to inform the design of adaptive AV interfaces for superior user experiences.
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-20
Open AccessWhen to Explain: Modeling User Need for Explanations in Real-World Autonomous Driving
The integration of artificial intelligence into autonomous vehicles (AVs) raises transparency challenges that can hinder user acceptance and experience. To address when users need AV explanations, we created a large-scale dataset of 3327 diverse driving scenarios, each paired with a user-friendly explanation, and conducted an online study to survey when users need explanations. Using both scenario and user-related factors, our best-performing tree-ensemble models predicted explanation need with great performance (F1=0.72, AUC=0.82). SHAP analyses revealed that while both user- and scenario-related factors matter, factors directly related to driving (AV driving style, AV action, event cause, annual mileage, human driving style) were more contributive than general demographics and environmental factors. Our study delivers a comprehensively annotated dataset that underpins future human-AV interaction research, an explainable model that reliably predicts explanation needs, and valuable insights to inform the design of adaptive AV interfaces for superior user experiences.
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-16
How Humans Naturally Refer to Targets: Understanding Multimodal Instruction Patterns in Human–Robot Interaction
Current multimodal instruction-recognition algorithms in human-robot interaction, developed largely from a purely technical perspective, remain rigid and incomplete in their use of human communicative cues. Therefore, a full understanding of how humans naturally refer to targets in interaction is central to enabling robots to interpret and act on user instructions. To investigate this, we collected multimodal behavior data from 30 participants who naturally instructed a robot for household tasks while we systematically varied target distance, direction, and local referent complexity. Our results show that speech instructions were often vague and lacked explicit target-position information. To resolve this ambiguity, multimodal cues are essential: gaze direction provides an order-of-magnitude improvement in target-localization accuracy, while hand pointing, head turns, and speech onset offer reliable temporal anchors for identifying target-directed gaze. We also found that speech patterns varied with distance and local referent complexity, whereas multimodal behaviors shifted with target direction, underscoring the need for context-adaptive recognition and interface design.
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Open AccessHow Humans Naturally Refer to Targets: Understanding Multimodal Instruction Patterns in Human–Robot Interaction
Current multimodal instruction-recognition algorithms in human-robot interaction, developed largely from a purely technical perspective, remain rigid and incomplete in their use of human communicative cues. Therefore, a full understanding of how humans naturally refer to targets in interaction is central to enabling robots to interpret and act on user instructions. To investigate this, we collected multimodal behavior data from 30 participants who naturally instructed a robot for household tasks while we systematically varied target distance, direction, and local referent complexity. Our results show that speech instructions were often vague and lacked explicit target-position information. To resolve this ambiguity, multimodal cues are essential: gaze direction provides an order-of-magnitude improvement in target-localization accuracy, while hand pointing, head turns, and speech onset offer reliable temporal anchors for identifying target-directed gaze. We also found that speech patterns varied with distance and local referent complexity, whereas multimodal behaviors shifted with target direction, underscoring the need for context-adaptive recognition and interface design.