Zhitian Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Zhitian Zhang has a total of 9 co-authors. Here are the top co-authors by number of shared publications:
- Shuai Guo
College of Information and Control Engineering, Qingdao University of Technology, Qingdao, China
3 shared publications - Dejiao Huang
School of Science, Qingdao University of Technology, Qingdao, China
2 shared publications - Menglei Xia
College of Information and Control Engineering, Qingdao University of Technology, Qingdao, China
2 shared publications - Ruyi Chang
School of Science, Qingdao University of Technology, Qingdao, China
2 shared publications - Chao Liu
Ocean University of China
1 shared publication Haopeng Wang
School of Police Information, Shandong Police College, Jinan, China
1 shared publication
Latest Publications
- 21 August 2025
- Published by Elsevier in Neurocomputing
- Vol. 654
VSTRD: An end-to-end video spatio-temporal relation detection transformer
- 21 August 2025
- Published by Elsevier in Neurocomputing
- Vol. 654
VSTRD: An end-to-end video spatio-temporal relation detection transformer
- Open Access
- 12 August 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 149247-149259
Multimodal Social Relationship Recognition Based on LLM
In recent years, multimodal social relation recognition has become a critical task in the fields of computer vision and natural language processing. However, existing research still faces key gaps, particularly in effectively aligning image features with linguistic features to improve recognition accuracy. This paper proposes a social relation recognition method based on multimodal feature fusion and validates the crucial role of cross-modal alignment mechanisms in enhancing recognition accuracy. Our approach leverages large language models to meticulously extract event structures from textual descriptions, capturing key elements such as emotional states, scenarios, and relationships, while employing convolutional neural networks to extract deep features from images. Subsequently, we introduce a cross-modal alignment mechanism to semantically align textual event structures with visual features, ensuring high semantic consistency between the two modalities. Extensive experiments on multiple public datasets demonstrate that our method significantly outperforms existing unimodal and basic multimodal approaches, confirming its effectiveness and innovative contributions to social relation recognition.
- 12 August 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 149247-149259
Open AccessMultimodal Social Relationship Recognition Based on LLM
In recent years, multimodal social relation recognition has become a critical task in the fields of computer vision and natural language processing. However, existing research still faces key gaps, particularly in effectively aligning image features with linguistic features to improve recognition accuracy. This paper proposes a social relation recognition method based on multimodal feature fusion and validates the crucial role of cross-modal alignment mechanisms in enhancing recognition accuracy. Our approach leverages large language models to meticulously extract event structures from textual descriptions, capturing key elements such as emotional states, scenarios, and relationships, while employing convolutional neural networks to extract deep features from images. Subsequently, we introduce a cross-modal alignment mechanism to semantically align textual event structures with visual features, ensuring high semantic consistency between the two modalities. Extensive experiments on multiple public datasets demonstrate that our method significantly outperforms existing unimodal and basic multimodal approaches, confirming its effectiveness and innovative contributions to social relation recognition.
- 9 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 12 (10) , 13477-13486
MATM-SN: A Deep-Reinforcement-Learning Model for Ocean Sensing Task Allocation Based on Generative Social Network
Due to the complexity of ocean sensing tasks, buoy detection in traditional ocean observation methods has the disadvantages of high cost and insufficient real-time performance. Ocean mobile crowd sensing technology collects high-resolution data in real-time through shipborne sensors and has significant potential for future development in the ocean Internet of Things. In this article, we consider a cooperative vessel activity that performs sensing tasks, incentivizing multiple vessels through dynamic external task profits. To spontaneously incentivize the team to take part in tasks and maximize the total profit of the vessels, we propose a multiagent task allocation model (MATM-SN) based on deep reinforcement learning (DRL). This model uses a generative adversarial network to predict the trajectory of the vessels, and STGCN is used to extract synergistic features between vessels effectively. DRL training provides an optimal task allocation strategy for vessels. Finally, we compared four baselines and demonstrated that the MATM-SN model outperformed other baselines regarding task completion rate and total efficiency.
- 9 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 12 (10) , 13477-13486
MATM-SN: A Deep-Reinforcement-Learning Model for Ocean Sensing Task Allocation Based on Generative Social Network
Due to the complexity of ocean sensing tasks, buoy detection in traditional ocean observation methods has the disadvantages of high cost and insufficient real-time performance. Ocean mobile crowd sensing technology collects high-resolution data in real-time through shipborne sensors and has significant potential for future development in the ocean Internet of Things. In this article, we consider a cooperative vessel activity that performs sensing tasks, incentivizing multiple vessels through dynamic external task profits. To spontaneously incentivize the team to take part in tasks and maximize the total profit of the vessels, we propose a multiagent task allocation model (MATM-SN) based on deep reinforcement learning (DRL). This model uses a generative adversarial network to predict the trajectory of the vessels, and STGCN is used to extract synergistic features between vessels effectively. DRL training provides an optimal task allocation strategy for vessels. Finally, we compared four baselines and demonstrated that the MATM-SN model outperformed other baselines regarding task completion rate and total efficiency.