Bo Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Bo Liu has a total of 14 co-authors. Here are the top co-authors by number of shared publications:
- Li Zhu
School of Software Engineering, Xi’an Jiaotong University, Xi’an 710049, China
3 shared publications - Bowen Zhang
Shenzhen Technology University
1 shared publication - Fei Guo
School of Software Engineering, Xian Jiaotong University, Xian, China
1 shared publication - Jianhao Wang
School of Software Engineering, Xi’an, China
1 shared publication - Lejian He
College of Engineering, Cornell University, 500 Hanshaw Rd, Ithaca, NY 14850, USA
1 shared publication - Sheng He
Kingdee International Software Group
1 shared publication
Latest Publications
- 30 March 2026
- Published by Springer Nature in International Journal of Machine Learning and Cybernetics
- Vol. 17 (5) , 239
Meme selection via multiple-choice with masked language models in multimodal dialogue
- 30 March 2026
- Published by Springer Nature in International Journal of Machine Learning and Cybernetics
- Vol. 17 (5) , 239
Meme selection via multiple-choice with masked language models in multimodal dialogue
- 14 September 2025
- Published by Springer Nature
- p. 3-19
A Multimodal Retrieval-Augmented Generation System for Intelligent Question Answering
- 14 September 2025
- Published by Springer Nature
- p. 3-19
A Multimodal Retrieval-Augmented Generation System for Intelligent Question Answering
- Open Access
- 20 October 2022
- Published by MDPI AG in Electronics
- Vol. 11 (20) , 3409
Transformer-Based Multimodal Infusion Dialogue Systems
The recent advancements in multimodal dialogue systems have been gaining importance in several domains such as retail, travel, fashion, among others. Several existing works have improved the understanding and generation of multimodal dialogues. However, there still exists considerable space to improve the quality of output textual responses due to insufficient information infusion between the visual and textual semantics. Moreover, the existing dialogue systems often generate defective knowledge-aware responses for tasks such as providing product attributes and celebrity endorsements. To address the aforementioned issues, we present a Transformer-based Multimodal Infusion Dialogue (TMID) system that extracts the visual and textual information from dialogues via a transformer-based multimodal context encoder and employs a cross-attention mechanism to achieve information infusion between images and texts for each utterance. Furthermore, TMID uses adaptive decoders to generate appropriate multimodal responses based on the user intentions it has determined using a state classifier and enriches the output responses by incorporating domain knowledge into the decoders. The results of extensive experiments on a multimodal dialogue dataset demonstrate that TMID has achieved a state-of-the-art performance by improving the BLUE-4 score by 13.03, NIST by 2.77, image selection Recall@1 by 1.84%.
- 20 October 2022
- Published by MDPI AG in Electronics
- Vol. 11 (20) , 3409
Open AccessTransformer-Based Multimodal Infusion Dialogue Systems
The recent advancements in multimodal dialogue systems have been gaining importance in several domains such as retail, travel, fashion, among others. Several existing works have improved the understanding and generation of multimodal dialogues. However, there still exists considerable space to improve the quality of output textual responses due to insufficient information infusion between the visual and textual semantics. Moreover, the existing dialogue systems often generate defective knowledge-aware responses for tasks such as providing product attributes and celebrity endorsements. To address the aforementioned issues, we present a Transformer-based Multimodal Infusion Dialogue (TMID) system that extracts the visual and textual information from dialogues via a transformer-based multimodal context encoder and employs a cross-attention mechanism to achieve information infusion between images and texts for each utterance. Furthermore, TMID uses adaptive decoders to generate appropriate multimodal responses based on the user intentions it has determined using a state classifier and enriches the output responses by incorporating domain knowledge into the decoders. The results of extensive experiments on a multimodal dialogue dataset demonstrate that TMID has achieved a state-of-the-art performance by improving the BLUE-4 score by 13.03, NIST by 2.77, image selection Recall@1 by 1.84%.