Stephanie Milani
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Stephanie Milani has a total of 24 co-authors. Here are the top co-authors by number of shared publications:
Fei Fang
School of Computer Science Carnegie Mellon University
4 shared publicationsCharles Kamhoua
Army Research Lab
3 shared publicationsEvangelos E. Papalexakis
University of California
2 shared publicationsNicholay Topin
Carnegie Mellon University
2 shared publicationsZheyuan Ryan Shi
Carnegie Mellon University
2 shared publicationsZhicheng Zhang
Carnegie Mellon University
2 shared publications
Latest Publications
- Open Access
- 15 October 2025
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society
- Vol. 8 (1) , 567-578
Making Teams and Influencing Agents: Efficiently Coordinating Decision Trees for Interpretable Multi-Agent Reinforcement Learning
Poor interpretability hinders the practical applicability of multi-agent reinforcement learning (MARL) policies. Deploying interpretable surrogates of uninterpretable policies enhances the safety and verifiability of MARL for real-world applications. However, if these surrogates are to interact directly with the environment within human supervisory frameworks, they must be both performant and computationally efficient. Prior work on interpretable MARL has either sacrificed performance for computational efficiency or computational efficiency for performance. To address this issue, we propose HYDRAVIPER, a decision tree-based interpretable MARL algorithm. HYDRAVIPER coordinates training between agents based on expected team performance, and adaptively allocates budgets for environment interaction to improve computational efficiency. Experiments on standard benchmark environments for multi-agent coordination and traffic signal control show that HYDRAVIPER matches the performance of state-of-the-art methods using a fraction of the runtime, and that it maintains a Pareto frontier of performance for different interaction budgets.
- 15 October 2025
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society
- Vol. 8 (1) , 567-578
Open AccessMaking Teams and Influencing Agents: Efficiently Coordinating Decision Trees for Interpretable Multi-Agent Reinforcement Learning
Poor interpretability hinders the practical applicability of multi-agent reinforcement learning (MARL) policies. Deploying interpretable surrogates of uninterpretable policies enhances the safety and verifiability of MARL for real-world applications. However, if these surrogates are to interact directly with the environment within human supervisory frameworks, they must be both performant and computationally efficient. Prior work on interpretable MARL has either sacrificed performance for computational efficiency or computational efficiency for performance. To address this issue, we propose HYDRAVIPER, a decision tree-based interpretable MARL algorithm. HYDRAVIPER coordinates training between agents based on expected team performance, and adaptively allocates budgets for environment interaction to improve computational efficiency. Experiments on standard benchmark environments for multi-agent coordination and traffic signal control show that HYDRAVIPER matches the performance of state-of-the-art methods using a fraction of the runtime, and that it maintains a Pareto frontier of performance for different interaction budgets.
- Top Cited PapersOpen Access
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 12772-12797
PATIENT-𝜓: Using Large Language Models to Simulate Patients for Training Mental Health Professionals
Ruiyi Wang, Stephanie Milani, Jamie C. Chiu, Jiayin Zhi, Shaun M. Eack, Travis Labrum, Samuel M Murphy, Nev Jones, Kate V Hardy, Hong Shen, Fei Fang, Zhiyu Chen. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing. 2024.
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 12772-12797
Top Cited PapersOpen AccessPATIENT-𝜓: Using Large Language Models to Simulate Patients for Training Mental Health Professionals
Ruiyi Wang, Stephanie Milani, Jamie C. Chiu, Jiayin Zhi, Shaun M. Eack, Travis Labrum, Samuel M Murphy, Nev Jones, Kate V Hardy, Hong Shen, Fei Fang, Zhiyu Chen. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing. 2024.
- 17 March 2023
- Published by Springer Nature
- p. 251-266
MAVIPER: Learning Decision Tree Policies for Interpretable Multi-agent Reinforcement Learning
- 17 March 2023
- Published by Springer Nature
- p. 251-266
MAVIPER: Learning Decision Tree Policies for Interpretable Multi-agent Reinforcement Learning
- Open Access
MAVIPER: Learning Decision Tree Policies for Interpretable Multi-Agent Reinforcement Learning
Many recent breakthroughs in multi-agent reinforcement learning (MARL) require the use of deep neural networks, which are challenging for human experts to interpret and understand. On the other hand, existing work on interpretable reinforcement learning (RL) has shown promise in extracting more interpretable decision tree-based policies from neural networks, but only in the single-agent setting. To fill this gap, we propose the first set of algorithms that extract interpretable decision-tree policies from neural networks trained with MARL. The first algorithm, IVIPER, extends VIPER, a recent method for single-agent interpretable RL, to the multi-agent setting. We demonstrate that IVIPER learns high-quality decision-tree policies for each agent. To better capture coordination between agents, we propose a novel centralized decision-tree training algorithm, MAVIPER. MAVIPER jointly grows the trees of each agent by predicting the behavior of the other agents using their anticipated trees, and uses resampling to focus on states that are critical for its interactions with other agents. We show that both algorithms generally outperform the baselines and that MAVIPER-trained agents achieve better-coordinated performance than IVIPER-trained agents on three different multi-agent particle-world environments.
Open AccessMAVIPER: Learning Decision Tree Policies for Interpretable Multi-Agent Reinforcement Learning
Many recent breakthroughs in multi-agent reinforcement learning (MARL) require the use of deep neural networks, which are challenging for human experts to interpret and understand. On the other hand, existing work on interpretable reinforcement learning (RL) has shown promise in extracting more interpretable decision tree-based policies from neural networks, but only in the single-agent setting. To fill this gap, we propose the first set of algorithms that extract interpretable decision-tree policies from neural networks trained with MARL. The first algorithm, IVIPER, extends VIPER, a recent method for single-agent interpretable RL, to the multi-agent setting. We demonstrate that IVIPER learns high-quality decision-tree policies for each agent. To better capture coordination between agents, we propose a novel centralized decision-tree training algorithm, MAVIPER. MAVIPER jointly grows the trees of each agent by predicting the behavior of the other agents using their anticipated trees, and uses resampling to focus on states that are critical for its interactions with other agents. We show that both algorithms generally outperform the baselines and that MAVIPER-trained agents achieve better-coordinated performance than IVIPER-trained agents on three different multi-agent particle-world environments.
- 22 December 2020
- Published by Springer Nature
- p. 147-167
Harnessing the Power of Deception in Attack Graph-Based Security Games
- 22 December 2020
- Published by Springer Nature
- p. 147-167
Harnessing the Power of Deception in Attack Graph-Based Security Games