Jieer Ouyang
Research Subjects
Jieer Ouyang has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Zheng Wang
Huawei Technologies, Co., Ltd
2 shared publications Shu Teo
Huawei Technologies, Co., Ltd
1 shared publication- Wei Shi
Huawei Technologies, Co., Ltd
1 shared publication - Xiaoneng Xiang
Huawei Singapore Research Center Singapore
1 shared publication - Yangkai Ding
Huawei Technologies Co., Ltd
1 shared publication - Yongjun Xu
Huawei Technologies, Co., Ltd
1 shared publication
Latest Publications
- Open Access
OTTER: Open-Tagging via Text-Image Representation for Multi-modal Understanding
We introduce OTTER, a unified open-set multi-label tagging framework that harmonizes the stability of a curated, predefined category set with the adaptability of user-driven open tags. OTTER is built upon a large-scale, hierarchically organized multi-modal dataset, collected from diverse online repositories and annotated through a hybrid pipeline combining automated vision-language labeling with human refinement. By leveraging a multi-head attention architecture, OTTER jointly aligns visual and textual representations with both fixed and open-set label embeddings, enabling dynamic and semantically consistent tagging. OTTER consistently outperforms competitive baselines on two benchmark datasets: it achieves an overall F1 score of 0.81 on Otter and 0.75 on Favorite, surpassing the next-best results by margins of 0.10 and 0.02, respectively. OTTER attains near-perfect performance on open-set labels, with F1 of 0.99 on Otter and 0.97 on Favorite, while maintaining competitive accuracy on predefined labels. These results demonstrate OTTER's effectiveness in bridging closed-set consistency with open-vocabulary flexibility for multi-modal tagging applications.
Open AccessOTTER: Open-Tagging via Text-Image Representation for Multi-modal Understanding
We introduce OTTER, a unified open-set multi-label tagging framework that harmonizes the stability of a curated, predefined category set with the adaptability of user-driven open tags. OTTER is built upon a large-scale, hierarchically organized multi-modal dataset, collected from diverse online repositories and annotated through a hybrid pipeline combining automated vision-language labeling with human refinement. By leveraging a multi-head attention architecture, OTTER jointly aligns visual and textual representations with both fixed and open-set label embeddings, enabling dynamic and semantically consistent tagging. OTTER consistently outperforms competitive baselines on two benchmark datasets: it achieves an overall F1 score of 0.81 on Otter and 0.75 on Favorite, surpassing the next-best results by margins of 0.10 and 0.02, respectively. OTTER attains near-perfect performance on open-set labels, with F1 of 0.99 on Otter and 0.97 on Favorite, while maintaining competitive accuracy on predefined labels. These results demonstrate OTTER's effectiveness in bridging closed-set consistency with open-vocabulary flexibility for multi-modal tagging applications.
- Open Access
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 1966-1978
M-RAG: Reinforcing Large Language Model Performance through Retrieval-Augmented Generation with Multiple Partitions
Zheng Wang, Shu Teo, Jieer Ouyang, Yongjun Xu, Wei Shi. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 1966-1978
Open AccessM-RAG: Reinforcing Large Language Model Performance through Retrieval-Augmented Generation with Multiple Partitions
Zheng Wang, Shu Teo, Jieer Ouyang, Yongjun Xu, Wei Shi. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.