WWWeicheng Wang

Weicheng Wang

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Weicheng Wang has a total of 8 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    A Multimodal Large Language Model for Forestry in pest and disease recognition

    by Maolin Zhang, Xianyong Li, Yajun Du, Zihan Rao, Songlin Chen, Weicheng Wang, Xiaoliang Chen, Dong Huang, Shumin Wang

    In the context of generative multimodal dialogue, the amalgamation of image and text forms the fundamental basis for a wide array of visual and language tasks. Despite the proliferation of large language models (LLMs), research on training LLMs for multimodal reasoning has remained relatively scarce. The progression of existing multimodal models has been propelled by using expansive image-text datasets in broader domains. Nevertheless, these models need refinement when comprehending and engaging in dialogue concerning Chinese forestry biological images. This paper proposes an efficient and adaptive multimodal large language model for forestry (MLLM-For) in pest and disease recognition. The central concept involves harnessing our meticulously constructed, expansive Chinese forestry biological image caption dataset. We utilize open-ended instruction-following data to master the intricacies of open-ended dialogue semantics, facilitating the comprehensive assimilation of knowledge within forestry biology. In particular, the Querying Transformer (Q-Former) module is a conduit linking pre-trained visual and language models. Using image-text pairs, the China Open Source Chat Language Model (ChatGLM) can now align vocabulary specific to forestry pests and diseases. By aligning image features with the pre-trained language model, we undertake concurrent Low-Rank Adaptive (LoRA) fine-tuning of the ChatGLM model. Furthermore, we engage in high-caliber instruction data fine-tuning to 1 tailor it to the proposed multimodal task. The proposed MLLM-For model show-cases impressive proficiency in comprehending and engaging in dialogue regarding Chinese forestry pests and disease images. It also displays exceptional capabilities in multimodal dialogue and is adept at adhering to open-ended directives for retrieving information about forestry pests and diseases. Empirical findings affirm the competitive performance of the MLLM-For model within the realm of Chinese multimodal dialogue, surpassing five leading multimodal large language models.