Tong Chen
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Tong Chen has a total of 16 co-authors. Here are the top co-authors by number of shared publications:
- Zhao Li
Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center (National Supercomputer Center in Jinan), Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, China
4 shared publications - Shiwei Wu
Evay Info, Jinan 250101, China
2 shared publications Canjun Wang
Qilu University of Technology (Shandong Academy of Sciences)
1 shared publication- Canjun Wang
Faculty of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, China
1 shared publication Chao Zhang
Qilu University of Technology (Shandong Academy of Sciences)
1 shared publication- Chao Zhang
School of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, China
1 shared publication
Latest Publications
- Open Access
- 14 June 2024
- Published by MDPI AG in Electronics
- Vol. 13 (12) , 2331
Entity Alignment with Global Information Aggregation
Entity alignment (EA) is a critical task in knowledge graph fusion, aiming to associate equivalent entities across disparate knowledge graphs (KGs). Current methods typically leverage entity representations derived from triples or neighboring entities, employing similarity matching for alignment. These approaches, however, tend to be overly reliant on proximal neighbor information and struggle with graph over-smoothing introduced by neighborhood aggregation. In response to these limitations, this study introduces a Global Information Aggregator (GIA), a new method that aims to enhance entity representation and simultaneously alleviate over-smoothing by merging the global structural information of the entire knowledge graph. Specifically, we propose a PageRank-based method to aggregate the global structural information of KGs. In addition, the GIA generates a diffusion-augmented graph by propagating and integrating the global information of the KGs. This graph is subsequently compared with a structural perturbation-augmented graph to yield more robust and comprehensive entity representations, thus further improving the model’s alignment performance. Extensive experiments on four benchmark datasets show that the GIA model is highly competitive with current state-of-the-art entity alignment frameworks.
- 14 June 2024
- Published by MDPI AG in Electronics
- Vol. 13 (12) , 2331
Open AccessEntity Alignment with Global Information Aggregation
Entity alignment (EA) is a critical task in knowledge graph fusion, aiming to associate equivalent entities across disparate knowledge graphs (KGs). Current methods typically leverage entity representations derived from triples or neighboring entities, employing similarity matching for alignment. These approaches, however, tend to be overly reliant on proximal neighbor information and struggle with graph over-smoothing introduced by neighborhood aggregation. In response to these limitations, this study introduces a Global Information Aggregator (GIA), a new method that aims to enhance entity representation and simultaneously alleviate over-smoothing by merging the global structural information of the entire knowledge graph. Specifically, we propose a PageRank-based method to aggregate the global structural information of KGs. In addition, the GIA generates a diffusion-augmented graph by propagating and integrating the global information of the KGs. This graph is subsequently compared with a structural perturbation-augmented graph to yield more robust and comprehensive entity representations, thus further improving the model’s alignment performance. Extensive experiments on four benchmark datasets show that the GIA model is highly competitive with current state-of-the-art entity alignment frameworks.
- Open Access
- 9 August 2023
- Published by MDPI AG in Electronics
- Vol. 12 (16) , 3391
Research on the Application of Prompt Learning Pretrained Language Model in Machine Translation Task with Reinforcement Learning
With the continuous advancement of deep learning technology, pretrained language models have emerged as crucial tools for natural language processing tasks. However, optimization of pretrained language models is essential for specific tasks such as machine translation. This paper presents a novel approach that integrates reinforcement learning with prompt learning to enhance the performance of pretrained language models in machine translation tasks. In our methodology, a “prompt” string is incorporated into the input of the pretrained language model, to guide the generation of an output that aligns closely with the target translation. Reinforcement learning is employed to train the model in producing optimal translation results. During this training process, the target translation is utilized as a reward signal to incentivize the model to generate an output that aligns more closely with the desired translation. Experimental results validated the effectiveness of the proposed approach. The pretrained language model trained with prompt learning and reinforcement learning exhibited superior performance compared to traditional pretrained language models in machine translation tasks. Furthermore, we observed that different prompt strategies significantly impacted the model’s performance, underscoring the importance of selecting an optimal prompt strategy tailored to the specific task. The results suggest that using techniques such as prompt learning and reinforcement learning can improve the performance of pretrained language models for tasks such as text generation and machine translation. The method proposed in this paper not only offers a fresh perspective on leveraging pretrained language models in machine translation and other related tasks but also serves as a valuable reference for further research in this domain. By combining reinforcement learning with prompt learning, researchers can explore new avenues for optimizing pretrained language models and improving their efficacy in various natural language processing tasks.
- 9 August 2023
- Published by MDPI AG in Electronics
- Vol. 12 (16) , 3391
Open AccessResearch on the Application of Prompt Learning Pretrained Language Model in Machine Translation Task with Reinforcement Learning
With the continuous advancement of deep learning technology, pretrained language models have emerged as crucial tools for natural language processing tasks. However, optimization of pretrained language models is essential for specific tasks such as machine translation. This paper presents a novel approach that integrates reinforcement learning with prompt learning to enhance the performance of pretrained language models in machine translation tasks. In our methodology, a “prompt” string is incorporated into the input of the pretrained language model, to guide the generation of an output that aligns closely with the target translation. Reinforcement learning is employed to train the model in producing optimal translation results. During this training process, the target translation is utilized as a reward signal to incentivize the model to generate an output that aligns more closely with the desired translation. Experimental results validated the effectiveness of the proposed approach. The pretrained language model trained with prompt learning and reinforcement learning exhibited superior performance compared to traditional pretrained language models in machine translation tasks. Furthermore, we observed that different prompt strategies significantly impacted the model’s performance, underscoring the importance of selecting an optimal prompt strategy tailored to the specific task. The results suggest that using techniques such as prompt learning and reinforcement learning can improve the performance of pretrained language models for tasks such as text generation and machine translation. The method proposed in this paper not only offers a fresh perspective on leveraging pretrained language models in machine translation and other related tasks but also serves as a valuable reference for further research in this domain. By combining reinforcement learning with prompt learning, researchers can explore new avenues for optimizing pretrained language models and improving their efficacy in various natural language processing tasks.
- Open Access
- 7 November 2022
- Published by MDPI AG in Electronics
- Vol. 11 (21) , 3638
Multitopic Coherence Extraction for Global Entity Linking
Entity linking is a process of linking mentions in a document with entities in a knowledge base. Collective entity disambiguation refers to mapping of multiple mentions in a document with their corresponding entities in a knowledge base. Most previous research has been based on the assumption that all mentions in the same document represent the same topic. However, mentions usually correspond to different topics. In this article, we proposes a new global model to explore the extraction of multitopic coherence in the same document. Herein, we present mention association graphs and candidate entity association graphs to obtain multitopic coherence features of the same document using graph neural networks (GNNs). In particular, we propose a variant GNN for our model and a particular graph readout function. We conducted extensive experiments on several datasets to demonstrate the effectiveness to the proposed model.
- 7 November 2022
- Published by MDPI AG in Electronics
- Vol. 11 (21) , 3638
Open AccessMultitopic Coherence Extraction for Global Entity Linking
Entity linking is a process of linking mentions in a document with entities in a knowledge base. Collective entity disambiguation refers to mapping of multiple mentions in a document with their corresponding entities in a knowledge base. Most previous research has been based on the assumption that all mentions in the same document represent the same topic. However, mentions usually correspond to different topics. In this article, we proposes a new global model to explore the extraction of multitopic coherence in the same document. Herein, we present mention association graphs and candidate entity association graphs to obtain multitopic coherence features of the same document using graph neural networks (GNNs). In particular, we propose a variant GNN for our model and a particular graph readout function. We conducted extensive experiments on several datasets to demonstrate the effectiveness to the proposed model.
- 24 September 2022
- Published by Springer Nature
- p. 168-178
An Interactive Fusion Model for Hierarchical Multi-label Text Classification
- 24 September 2022
- Published by Springer Nature
- p. 168-178
An Interactive Fusion Model for Hierarchical Multi-label Text Classification