ZZZhitian Zhang

Zhitian Zhang

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Zhitian Zhang has a total of 9 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • VSTRD: An end-to-end video spatio-temporal relation detection transformer

    by Ruyi Chang, Haopeng Wang, Zhitian Zhang, Dejiao Huang, Shuai Guo


  • Open Access

    Multimodal Social Relationship Recognition Based on LLM

    by Haopeng Wang, Zhitian Zhang, Menglei Xia, Dejiao Huang, Ruyi Chang, Shuai Guo

    In recent years, multimodal social relation recognition has become a critical task in the fields of computer vision and natural language processing. However, existing research still faces key gaps, particularly in effectively aligning image features with linguistic features to improve recognition accuracy. This paper proposes a social relation recognition method based on multimodal feature fusion and validates the crucial role of cross-modal alignment mechanisms in enhancing recognition accuracy. Our approach leverages large language models to meticulously extract event structures from textual descriptions, capturing key elements such as emotional states, scenarios, and relationships, while employing convolutional neural networks to extract deep features from images. Subsequently, we introduce a cross-modal alignment mechanism to semantically align textual event structures with visual features, ensuring high semantic consistency between the two modalities. Extensive experiments on multiple public datasets demonstrate that our method significantly outperforms existing unimodal and basic multimodal approaches, confirming its effectiveness and innovative contributions to social relation recognition.

  • MATM-SN: A Deep-Reinforcement-Learning Model for Ocean Sensing Task Allocation Based on Generative Social Network

    by Shuai Guo, Menglei Xia, Huanqun Xue, Yutong Song, Zhitian Zhang, Chao Liu

    Due to the complexity of ocean sensing tasks, buoy detection in traditional ocean observation methods has the disadvantages of high cost and insufficient real-time performance. Ocean mobile crowd sensing technology collects high-resolution data in real-time through shipborne sensors and has significant potential for future development in the ocean Internet of Things. In this article, we consider a cooperative vessel activity that performs sensing tasks, incentivizing multiple vessels through dynamic external task profits. To spontaneously incentivize the team to take part in tasks and maximize the total profit of the vessels, we propose a multiagent task allocation model (MATM-SN) based on deep reinforcement learning (DRL). This model uses a generative adversarial network to predict the trajectory of the vessels, and STGCN is used to extract synergistic features between vessels effectively. DRL training provides an optimal task allocation strategy for vessels. Finally, we compared four baselines and demonstrated that the MATM-SN model outperformed other baselines regarding task completion rate and total efficiency.