ACAnkush Chatterjee
Ankush Chatterjee
*This is an algorithmically generated author record based on publicly available information.
Ankush Chatterjee has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Kedhar Nath Narahari
Microsoft
2 shared publications - Manish Gupta
Microsoft Corporation, Hyderabad, India
2 shared publications - Puneet Agrawal
Microsoft
2 shared publications - Sonam Damani
Microsoft
2 shared publications - Meghana Joshi
Microsoft
1 shared publication - Sahil Chelaramani
Microsoft
1 shared publication
Latest Publications
- 8 April 2022
- Published by Springer Nature
- p. 413-424
Query-Document Topic Mismatch Detection
- 6 May 2020
- Published by Springer Nature
- Vol. 12084, 235-248
Optimized Transformer Models for FAQ Answering
Informational chatbots provide a highly effective medium for improving operational efficiency in answering customer queries for any enterprise. Chatbots are also preferred by users/customers since unlike other alternatives like calling customer care or browsing over FAQ pages, chatbots provide instant responses, are easy to use, are less invasive and are always available. In this paper, we discuss the problem of FAQ answering which is central to designing a retrieval-based informational chatbot. Given a set of FAQ pages s for an enterprise, and a user query, we need to find the best matching question-answer pairs from s. Building such a semantic ranking system that works well across domains for large QA databases with low runtime and model size is challenging. Previous work based on feature engineering or recurrent neural models either provides low accuracy or incurs high runtime costs. We experiment with multiple transformer based deep learning models, and also propose a novel MT-DNN (Multi-task Deep Neural Network)-based architecture, which we call Masked MT-DNN (or MMT-DNN). MMT-DNN significantly outperforms other state-of-the-art transformer models for the FAQ answering task. Further, we propose an improved knowledge distillation component to achieve \(\sim \)2.4x reduction in model-size and \(\sim \)7x reduction in runtime while maintaining similar accuracy. On a small benchmark dataset from SemEval 2017 CQA Task 3, we show that our approach provides an NDCG@1 of 83.1. On another large dataset of \(\sim \)281K instances corresponding to \(\sim \)30K queries from diverse domains, our distilled 174 MB model provides an NDCG@1 of 75.08 with a CPU runtime of mere 31 ms establishing a new state-of-the-art for FAQ answering.- 6 May 2020
- Published by Springer Nature
- Vol. 12084, 235-248
Optimized Transformer Models for FAQ Answering
Informational chatbots provide a highly effective medium for improving operational efficiency in answering customer queries for any enterprise. Chatbots are also preferred by users/customers since unlike other alternatives like calling customer care or browsing over FAQ pages, chatbots provide instant responses, are easy to use, are less invasive and are always available. In this paper, we discuss the problem of FAQ answering which is central to designing a retrieval-based informational chatbot. Given a set of FAQ pages s for an enterprise, and a user query, we need to find the best matching question-answer pairs from s. Building such a semantic ranking system that works well across domains for large QA databases with low runtime and model size is challenging. Previous work based on feature engineering or recurrent neural models either provides low accuracy or incurs high runtime costs. We experiment with multiple transformer based deep learning models, and also propose a novel MT-DNN (Multi-task Deep Neural Network)-based architecture, which we call Masked MT-DNN (or MMT-DNN). MMT-DNN significantly outperforms other state-of-the-art transformer models for the FAQ answering task. Further, we propose an improved knowledge distillation component to achieve \(\sim \)2.4x reduction in model-size and \(\sim \)7x reduction in runtime while maintaining similar accuracy. On a small benchmark dataset from SemEval 2017 CQA Task 3, we show that our approach provides an NDCG@1 of 83.1. On another large dataset of \(\sim \)281K instances corresponding to \(\sim \)30K queries from diverse domains, our distilled 174 MB model provides an NDCG@1 of 75.08 with a CPU runtime of mere 31 ms establishing a new state-of-the-art for FAQ answering.