HCHaoru Chen

Haoru Chen

*This is an algorithmically generated author record based on publicly available information.

Haoru Chen has a total of 16 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Dynamic Distribution-Aware Uncertainty Tracking in Vision-Language Representation Learning

    by Ao Zhou, Zhiwei Jiang, Zifeng Cheng, Cong Wang, Shufan Yang, Haoru Chen, Qing Gu

  • Open Access

    Large Scale Hierarchical User Interest Modeling for Click-through Rate Prediction

    by Taofeng Xue, Zhimin Lin, Zijian Zhang, Linsen Guo, Haoru Chen, Mengjiao Bao, Peng Yan

    With the explosive growth of online information, recommender systems have emerged as indispensable tools for navigating the complexities of content generation, discovery and consumption. The RecSys 2024 Challenge, organized by Ekstra Bladet, provides a comprehensive dataset and a robust news recommendation evaluation framework for tackling multifaceted challenges including modeling user preferences based on implicit behavior, accounting for the influence of the news agenda on user interests, and managing the rapid decay of news items. In this paper, we propose a novel Hierarchical User Interest Modeling (HUIM) approach to this challenge, leveraging both long-term invariant interests and short-term rapidly changing interests. Specifically, we utilize the multimodal representations along with the side information of items to distill the long-standing interests from user historical behaviors. By analyzing real-time context and user behavioral path patterns, we identify their fine-grained instant interests. Finally, an interest fusion network is proposed to adaptively fuse the long-term and short-term interests by contrasting the query-aware fine-grained behaviors with query-level cross entropy loss. Our team, BlackPearl, achieved a score of 0.8815 and ranked 2nd place on the final leaderboard.


  • Open Access

    VTQAGen: BART-based Generative Model For Visual Text Question Answering

    by Haoru Chen, Tianjiao Wan, Zhimin Lin, Kele Xu, Jin Wang, Huaimin Wang

    Visual Text Question Answering (VTQA) is a challenging task that requires answering questions pertaining to visual content by combining image understanding and language comprehension. The main objective is to develop models that can accurately provide relevant answers based on complementary information from both images and text, as well as the semantic meaning of the question. Despite ongoing efforts, the VTQA task presents several challenges, including multimedia alignment, multi-step cross-media reasoning, and handling open-ended questions. This paper introduces a novel generative framework called VTQAGen, which leverages a Multi- modal Attention Layer to combine image-text pairs and question inputs, as well as a BART-based model for reasoning and entity extraction from both images and text. The framework incorporates a step-based ensemble method to enhance model performance and generalization ability. VTQAGen utilizes an encoder-decoder generative model based on BART. Faster R-CNN is employed to extract visual regions of interest, while BART's encoder is modified to handle multi-modal interaction. The decoder stage utilizes the shift-predict approach and introduces step-based logits fusion to improve stability and accuracy. In the experiments, the proposed VTQAGen demonstrates superior performance on the testing set, securing second place in the ACM Multimedia Visual Text Question Answer Challenge.