Yasutaka Nishimura
Yasutaka Nishimura has a total of 27 co-authors. Here are the top co-authors by number of shared publications:
- Roberto Legaspi
KDDI Research, Inc., Fujimino, Japan
4 shared publications - Kazushi Ikeda
Division of Information Science, Nara Institute of Science and Technology, Nara, Japan
3 shared publications - Naoto Takeda
KDDI Research, Inc.,AI Division,Fujimino,Japan
3 shared publications - Sonia Chernova
Georgia Institute of Technology, Atlanta, USA
3 shared publications Thomas Plötz
School of Interactive Computing, College of Computing, Georgia Institute of Technology,Atlanta,USA
2 shared publications- Akihiro Miyamoto
Center for Information and Neural Networks (CiNet), Advanced ICT Research Institute, National Institute of Information and Communications Technology
1 shared publication
Latest Publications
- Open Access
- 3 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 440-453
CartoMapQA: A Fundamental Benchmark Dataset Evaluating Vision-Language Models on Cartographic Map Understanding
- 3 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 440-453
Open AccessCartoMapQA: A Fundamental Benchmark Dataset Evaluating Vision-Language Models on Cartographic Map Understanding
- 10 April 2024
- Published by Springer Nature
- p. 273-286
Estimating Sense of Agency from Behavioral Logs: Toward a Just-in-Time Adaptive Intervention System
- 10 April 2024
- Published by Springer Nature
- p. 273-286
Estimating Sense of Agency from Behavioral Logs: Toward a Just-in-Time Adaptive Intervention System
- 15 December 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 158-165
ALLFA: Active Learning Through Label and Feature Augmentation
We introduce a novel feature-based active learning approach that leverages leading feature selection methods from explainable AI (XAI) to elicit user corrections on both the classification label and the leading features contributing to the classification decision. Uniquely, our approach can handle such user corrections, which identify missing and superfluous features in a model-agnostic manner that can be applied to any supervised classification model. Our approach generates augmented samples in a fine-grained manner according to user corrections, and then adds them to the training data to teach relevant and irrelevant features. Our results show that our approach outperforms traditional active learning and a leading baseline in two domains, which includes improvement in classification performance from 0.572 to 0.637 given the same number of queries.
- 15 December 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 158-165
ALLFA: Active Learning Through Label and Feature Augmentation
We introduce a novel feature-based active learning approach that leverages leading feature selection methods from explainable AI (XAI) to elicit user corrections on both the classification label and the leading features contributing to the classification decision. Uniquely, our approach can handle such user corrections, which identify missing and superfluous features in a model-agnostic manner that can be applied to any supervised classification model. Our approach generates augmented samples in a fine-grained manner according to user corrections, and then adds them to the training data to teach relevant and irrelevant features. Our results show that our approach outperforms traditional active learning and a leading baseline in two domains, which includes improvement in classification performance from 0.572 to 0.637 given the same number of queries.
- Open Access
- 5 May 2023
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Interactive Intelligent Systems
- Vol. 13 (2) , 1-39
Explainable Activity Recognition for Smart Home Systems
Smart home environments are designed to provide services that help improve the quality of life for the occupant via a variety of sensors and actuators installed throughout the space. Many automated actions taken by a smart home are governed by the output of an underlying activity recognition system. However, activity recognition systems may not be perfectly accurate, and therefore inconsistencies in smart home operations can lead users reliant on smart home predictions to wonder “Why did the smart home do that?” In this work, we build on insights from Explainable Artificial Intelligence (XAI) techniques and introduce an explainable activity recognition framework in which we leverage leading XAI methods (Local Interpretable Model-agnostic Explanations, SHapley Additive exPlanations (SHAP), Anchors) to generate natural language explanations that explain what about an activity led to the given classification. We evaluate our framework in the context of a commonly targeted smart home scenario: autonomous remote caregiver monitoring for individuals who are living alone or need assistance. Within the context of remote caregiver monitoring, we perform a two-step evaluation: (a) utilize Machine Learning experts to assess the sensibility of explanations and (b) recruit non-experts in two user remote caregiver monitoring scenarios, synchronous and asynchronous, to assess the effectiveness of explanations generated via our framework. Our results show that the XAI approach, SHAP, has a 92% success rate in generating sensible explanations. Moreover, in 83% of sampled scenarios users preferred natural language explanations over a simple activity label, underscoring the need for explainable activity recognition systems. Finally, we show that explanations generated by some XAI methods can lead users to lose confidence in the accuracy of the underlying activity recognition model, while others lead users to gain confidence. Taking all studied factors into consideration, we make a recommendation regarding which existing XAI method leads to the best performance in the domain of smart home automation and discuss a range of topics for future work to further improve explainable activity recognition.
- 5 May 2023
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Interactive Intelligent Systems
- Vol. 13 (2) , 1-39
Open AccessExplainable Activity Recognition for Smart Home Systems
Smart home environments are designed to provide services that help improve the quality of life for the occupant via a variety of sensors and actuators installed throughout the space. Many automated actions taken by a smart home are governed by the output of an underlying activity recognition system. However, activity recognition systems may not be perfectly accurate, and therefore inconsistencies in smart home operations can lead users reliant on smart home predictions to wonder “Why did the smart home do that?” In this work, we build on insights from Explainable Artificial Intelligence (XAI) techniques and introduce an explainable activity recognition framework in which we leverage leading XAI methods (Local Interpretable Model-agnostic Explanations, SHapley Additive exPlanations (SHAP), Anchors) to generate natural language explanations that explain what about an activity led to the given classification. We evaluate our framework in the context of a commonly targeted smart home scenario: autonomous remote caregiver monitoring for individuals who are living alone or need assistance. Within the context of remote caregiver monitoring, we perform a two-step evaluation: (a) utilize Machine Learning experts to assess the sensibility of explanations and (b) recruit non-experts in two user remote caregiver monitoring scenarios, synchronous and asynchronous, to assess the effectiveness of explanations generated via our framework. Our results show that the XAI approach, SHAP, has a 92% success rate in generating sensible explanations. Moreover, in 83% of sampled scenarios users preferred natural language explanations over a simple activity label, underscoring the need for explainable activity recognition systems. Finally, we show that explanations generated by some XAI methods can lead users to lose confidence in the accuracy of the underlying activity recognition model, while others lead users to gain confidence. Taking all studied factors into consideration, we make a recommendation regarding which existing XAI method leads to the best performance in the domain of smart home automation and discuss a range of topics for future work to further improve explainable activity recognition.
- 13 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 659-664
Extraction of Important Temporal Order for eXplainable AI on Time-series data
We propose a new eXplainable AI method on time-series data in which multiple events are arranged in temporal order, to extract important temporal order between events for opaque model decision. Toward this, our proposed method analyzes the model behavior when inputting perturbated data generated by changing the order of the events. We evaluate our method via an exemplary classification task on a simulated dataset to confirm how accurate our method is in extracting important temporal order of events. In addition, we evaluate our method on a smart home sensor dataset to demonstrate what kind of important order is actually extracted.
- 13 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 659-664
Extraction of Important Temporal Order for eXplainable AI on Time-series data
We propose a new eXplainable AI method on time-series data in which multiple events are arranged in temporal order, to extract important temporal order between events for opaque model decision. Toward this, our proposed method analyzes the model behavior when inputting perturbated data generated by changing the order of the events. We evaluate our method via an exemplary classification task on a simulated dataset to confirm how accurate our method is in extracting important temporal order of events. In addition, we evaluate our method on a smart home sensor dataset to demonstrate what kind of important order is actually extracted.
- 19 January 2021
- Published by Springer Nature
- p. 41-53
Design and Evaluations of Multi-agent Simulation Model for Electric Power Sharing Among Households
- 19 January 2021
- Published by Springer Nature
- p. 41-53
Design and Evaluations of Multi-agent Simulation Model for Electric Power Sharing Among Households