Elnaz Nouri
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Elnaz Nouri has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- David Traum
USC Institute for Creative Technologies
2 shared publications David Traum
University of Southern California
1 shared publicationKallirroi Georgila
University of Southern California
1 shared publication- Kallirroi Georgila
USC Institute for Creative Technologies
1 shared publication - Satoshi Nakamura
Nara Institute of Science and Technology
1 shared publication - Takuya Hiraoka
Nara Institute of Science and Technology
1 shared publication
Latest Publications
- Open Access
- 1 January 2015
- Published by Japanese Society for Artificial Intelligence in Transactions of the Japanese Society for Artificial Intelligence
- Vol. 31 (4) , B-FC1_1-FC1_1
Reinforcement Learning of Multi-Party Trading Dialog Policies
Trading dialogs are a kind of negotiation in which an exchange of ownership of items is discussed, and these kinds of dialogs are pervasive in many situations. Recently, there has been an increasing amount of research on applying reinforcement learning (RL) to negotiation dialog domains. However, in previous research, the focus was on negotiation dialog between two participants only, ignoring cases where negotiation takes place between more than two interlocutors. In this paper, as a first study on multi-party negotiation, we apply RL to a multi-party trading scenario where the dialog system (learner) trades with one, two, or three other agents. We experiment with different RL algorithms and reward functions. We use Q-learning with linear function approximation, least-squares policy iteration, and neural fitted Q iteration. In addition, to make the learning process more efficient, we introduce an incremental reward function. The negotiation strategy of the learner is learned through simulated dialog with trader simulators. In our experiments, we evaluate how the performance of the learner varies depending on the RL algorithm used and the number of traders. Furthermore, we compare the learned dialog policies with two strong hand-crafted baseline dialog policies. Our results show that (1) even in simple multi-party trading dialog tasks, learning an effective negotiation policy is not a straightforward task and requires a lot of experimentation; and (2) the use of neural fitted Q iteration combined with an incremental reward function produces negotiation policies as effective or even better than the policies of the two strong hand-crafted baselines.
- 1 January 2015
- Published by Japanese Society for Artificial Intelligence in Transactions of the Japanese Society for Artificial Intelligence
- Vol. 31 (4) , B-FC1_1-FC1_1
Open AccessReinforcement Learning of Multi-Party Trading Dialog Policies
Trading dialogs are a kind of negotiation in which an exchange of ownership of items is discussed, and these kinds of dialogs are pervasive in many situations. Recently, there has been an increasing amount of research on applying reinforcement learning (RL) to negotiation dialog domains. However, in previous research, the focus was on negotiation dialog between two participants only, ignoring cases where negotiation takes place between more than two interlocutors. In this paper, as a first study on multi-party negotiation, we apply RL to a multi-party trading scenario where the dialog system (learner) trades with one, two, or three other agents. We experiment with different RL algorithms and reward functions. We use Q-learning with linear function approximation, least-squares policy iteration, and neural fitted Q iteration. In addition, to make the learning process more efficient, we introduce an incremental reward function. The negotiation strategy of the learner is learned through simulated dialog with trader simulators. In our experiments, we evaluate how the performance of the learner varies depending on the RL algorithm used and the number of traders. Furthermore, we compare the learned dialog policies with two strong hand-crafted baseline dialog policies. Our results show that (1) even in simple multi-party trading dialog tasks, learning an effective negotiation policy is not a straightforward task and requires a lot of experimentation; and (2) the use of neural fitted Q iteration combined with an incremental reward function produces negotiation policies as effective or even better than the policies of the two strong hand-crafted baselines.
- 29 October 2014
- Published by Springer Nature in AI & SOCIETY
- Vol. 32 (1) , 51-63
Culture-specific models of negotiation for virtual characters: multi-attribute decision-making based on culture-specific values
- 29 October 2014
- Published by Springer Nature in AI & SOCIETY
- Vol. 32 (1) , 51-63
Culture-specific models of negotiation for virtual characters: multi-attribute decision-making based on culture-specific values
- Open Access
- 1 January 2014
- Published by Association for Computational Linguistics (ACL)
- p. 186-193
Initiative Taking in Negotiation
Elnaz Nouri, David Traum. Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL). 2014.
- 1 January 2014
- Published by Association for Computational Linguistics (ACL)
- p. 186-193
Open AccessInitiative Taking in Negotiation
Elnaz Nouri, David Traum. Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL). 2014.