Haoru Chen
Research Subjects
Haoru Chen has a total of 16 co-authors. Here are the top co-authors by number of shared publications:
- Zhimin Lin
Meituan Search and Content Intelligence, China
2 shared publications - Ao Zhou
State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China
1 shared publication - Cong Wang
Nanjing University, Nanjing, China
1 shared publication - Huaimin Wang
National University of Defense Technology
1 shared publication - Jin Wang
Chongqing University of Posts and Telecommunications
1 shared publication - Kele Xu
National university of defense technology, Changsha, China
1 shared publication
Latest Publications
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 15832-15841
Dynamic Distribution-Aware Uncertainty Tracking in Vision-Language Representation Learning
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 15832-15841
Open AccessDynamic Distribution-Aware Uncertainty Tracking in Vision-Language Representation Learning
- Open Access
- 14 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 53-57
Large Scale Hierarchical User Interest Modeling for Click-through Rate Prediction
With the explosive growth of online information, recommender systems have emerged as indispensable tools for navigating the complexities of content generation, discovery and consumption. The RecSys 2024 Challenge, organized by Ekstra Bladet, provides a comprehensive dataset and a robust news recommendation evaluation framework for tackling multifaceted challenges including modeling user preferences based on implicit behavior, accounting for the influence of the news agenda on user interests, and managing the rapid decay of news items. In this paper, we propose a novel Hierarchical User Interest Modeling (HUIM) approach to this challenge, leveraging both long-term invariant interests and short-term rapidly changing interests. Specifically, we utilize the multimodal representations along with the side information of items to distill the long-standing interests from user historical behaviors. By analyzing real-time context and user behavioral path patterns, we identify their fine-grained instant interests. Finally, an interest fusion network is proposed to adaptively fuse the long-term and short-term interests by contrasting the query-aware fine-grained behaviors with query-level cross entropy loss. Our team, BlackPearl, achieved a score of 0.8815 and ranked 2nd place on the final leaderboard.
- 14 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 53-57
Open AccessLarge Scale Hierarchical User Interest Modeling for Click-through Rate Prediction
With the explosive growth of online information, recommender systems have emerged as indispensable tools for navigating the complexities of content generation, discovery and consumption. The RecSys 2024 Challenge, organized by Ekstra Bladet, provides a comprehensive dataset and a robust news recommendation evaluation framework for tackling multifaceted challenges including modeling user preferences based on implicit behavior, accounting for the influence of the news agenda on user interests, and managing the rapid decay of news items. In this paper, we propose a novel Hierarchical User Interest Modeling (HUIM) approach to this challenge, leveraging both long-term invariant interests and short-term rapidly changing interests. Specifically, we utilize the multimodal representations along with the side information of items to distill the long-standing interests from user historical behaviors. By analyzing real-time context and user behavioral path patterns, we identify their fine-grained instant interests. Finally, an interest fusion network is proposed to adaptively fuse the long-term and short-term interests by contrasting the query-aware fine-grained behaviors with query-level cross entropy loss. Our team, BlackPearl, achieved a score of 0.8815 and ranked 2nd place on the final leaderboard.
- Open Access
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 9456-9461
VTQAGen: BART-based Generative Model For Visual Text Question Answering
Visual Text Question Answering (VTQA) is a challenging task that requires answering questions pertaining to visual content by combining image understanding and language comprehension. The main objective is to develop models that can accurately provide relevant answers based on complementary information from both images and text, as well as the semantic meaning of the question. Despite ongoing efforts, the VTQA task presents several challenges, including multimedia alignment, multi-step cross-media reasoning, and handling open-ended questions. This paper introduces a novel generative framework called VTQAGen, which leverages a Multi- modal Attention Layer to combine image-text pairs and question inputs, as well as a BART-based model for reasoning and entity extraction from both images and text. The framework incorporates a step-based ensemble method to enhance model performance and generalization ability. VTQAGen utilizes an encoder-decoder generative model based on BART. Faster R-CNN is employed to extract visual regions of interest, while BART's encoder is modified to handle multi-modal interaction. The decoder stage utilizes the shift-predict approach and introduces step-based logits fusion to improve stability and accuracy. In the experiments, the proposed VTQAGen demonstrates superior performance on the testing set, securing second place in the ACM Multimedia Visual Text Question Answer Challenge.
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 9456-9461
Open AccessVTQAGen: BART-based Generative Model For Visual Text Question Answering
Visual Text Question Answering (VTQA) is a challenging task that requires answering questions pertaining to visual content by combining image understanding and language comprehension. The main objective is to develop models that can accurately provide relevant answers based on complementary information from both images and text, as well as the semantic meaning of the question. Despite ongoing efforts, the VTQA task presents several challenges, including multimedia alignment, multi-step cross-media reasoning, and handling open-ended questions. This paper introduces a novel generative framework called VTQAGen, which leverages a Multi- modal Attention Layer to combine image-text pairs and question inputs, as well as a BART-based model for reasoning and entity extraction from both images and text. The framework incorporates a step-based ensemble method to enhance model performance and generalization ability. VTQAGen utilizes an encoder-decoder generative model based on BART. Faster R-CNN is employed to extract visual regions of interest, while BART's encoder is modified to handle multi-modal interaction. The decoder stage utilizes the shift-predict approach and introduces step-based logits fusion to improve stability and accuracy. In the experiments, the proposed VTQAGen demonstrates superior performance on the testing set, securing second place in the ACM Multimedia Visual Text Question Answer Challenge.