Kaixiang Lin
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Kaixiang Lin has a total of 3 co-authors. Here are the top co-authors by number of shared publications:
- Feiyang Niu
Amazon Alexa AI Sunnyvale CA USA
1 shared publication - Govind Thattai
Amazon Alexa AI
1 shared publication - Tongzhou Mu
Department of Computer Science and Engineering University of California San Diego
1 shared publication
Latest Publications
- Open Access
Learning Two-Step Hybrid Policy for Graph-Based Interpretable Reinforcement Learning
We present a two-step hybrid reinforcement learning (RL) policy that is designed to generate interpretable and robust hierarchical policies on the RL problem with graph-based input. Unlike prior deep reinforcement learning policies parameterized by an end-to-end black-box graph neural network, our approach disentangles the decision-making process into two steps. The first step is a simplified classification problem that maps the graph input to an action group where all actions share a similar semantic meaning. The second step implements a sophisticated rule-miner that conducts explicit one-hop reasoning over the graph and identifies decisive edges in the graph input without the necessity of heavy domain knowledge. This two-step hybrid policy presents human-friendly interpretations and achieves better performance in terms of generalization and robustness. Extensive experimental studies on four levels of complex text-based games have demonstrated the superiority of the proposed method compared to the state-of-the-art.
Open AccessLearning Two-Step Hybrid Policy for Graph-Based Interpretable Reinforcement Learning
We present a two-step hybrid reinforcement learning (RL) policy that is designed to generate interpretable and robust hierarchical policies on the RL problem with graph-based input. Unlike prior deep reinforcement learning policies parameterized by an end-to-end black-box graph neural network, our approach disentangles the decision-making process into two steps. The first step is a simplified classification problem that maps the graph input to an action group where all actions share a similar semantic meaning. The second step implements a sophisticated rule-miner that conducts explicit one-hop reasoning over the graph and identifies decisive edges in the graph input without the necessity of heavy domain knowledge. This two-step hybrid policy presents human-friendly interpretations and achieves better performance in terms of generalization and robustness. Extensive experimental studies on four levels of complex text-based games have demonstrated the superiority of the proposed method compared to the state-of-the-art.