A Hybrid Retrieval-Generation Neural Conversation Model
Preprint
Abstract
Intelligent personal assistant systems that are able to have multi-turn conversations with human users are becoming increasingly popular. Most previous research has been focused on using either retrieval-based or generation-based methods to develop such systems. Retrieval-based methods have the advantage of returning fluent and informative responses with great diversity. However, the performance of the methods is limited by the size of the response repository. On the other hand, generation-based methods can produce highly coherent responses on any topics. But the generated responses are often generic and not informative due to the lack of grounding knowledge. In this paper, we propose a hybrid neural conversation model that combines the merits of both response retrieval and generation methods. Experimental results on Twitter and Foursquare data show that the proposed model outperforms both retrieval-based methods and generation-based methods (including a recently proposed knowledge-grounded neural conversation model) under both automatic evaluation metrics and human evaluation. We hope that the findings in this study provide new insights on how to integrate text retrieval and text generation models for building conversation systems.Keywords
All Related Versions
This publication has 34 references indexed in Scilit:
- A Deep Look into neural ranking models for information retrievalInformation Processing & Management, 2020
- Modelling Domain Relationships for Transfer Learning on Retrieval-based Question Answering Systems in E-commerce2018
- Joint Learning of Response Ranking and Next Utterance Suggestion in Human-Computer Conversation System2017
- End-to-End Neural Ad-hoc Ranking with Kernel Pooling2017
- A Language Modeling Approach to Information RetrievalACM SIGIR Forum, 2017
- Learning to Match using Local and Distributed Representations of Text for Web Search2017
- Learning to Respond with Deep Neural Networks for Retrieval-Based Human-Computer Conversation System2016
- Learning deep structured semantic models for web search using clickthrough data2013
- Some Simple Effective Approximations to the 2-Poisson Model for Probabilistic Weighted Retrieval1994
- Measuring nominal scale agreement among many raters.Psychological Bulletin, 1971