Daichi Guo
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Daichi Guo has a total of 12 co-authors. Here are the top co-authors by number of shared publications:
- Chen Zeng
Beijing University of Posts and Telecommunications, Beijing, China
1 shared publication - Dayuan Fu
Artificial intelligence, Beijing University of Posts and telecommunications, Beijing, beijing, China and artificial intelligence, Beijing University of Posts and telecommunications, Beijing, beijing, China
1 shared publication - Gang Zhao
Beijing University of Posts and Telecommunications, Beijing, China
1 shared publication - Guanting Dong
Renmin University of China, Beijing, China
1 shared publication - Jinxu Zhao
Beijing University of Posts and Telecommunications, Beijing, China
1 shared publication - Keqing He
Meituan Group, Beijing, China
1 shared publication
Latest Publications
- Open Access
- 21 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 430-440
A Multi-Task Semantic Decomposition Framework with Task-specific Pre-training for Few-Shot NER
The objective of few-shot named entity recognition is to identify named entities with limited labeled instances. Previous works have primarily focused on optimizing the traditional token-wise classification framework, while neglecting the exploration of information based on NER data characteristics. To address this issue, we propose a Multi-Task Semantic Decomposition Framework via Joint Task-specific Pre-training (MSDP) for few-shot NER. Drawing inspiration from demonstration-based and contrastive learning, we introduce two novel pre-training tasks: Demonstration-based Masked Language Modeling (MLM) and Class Contrastive Discrimination. These tasks effectively incorporate entity boundary information and enhance entity representation in Pre-trained Language Models (PLMs). In the downstream main task, we introduce a multi-task joint optimization framework with the semantic decomposing method, which facilitates the model to integrate two different semantic information for entity classification. Experimental results of two few-shot NER benchmarks demonstrate that MSDP consistently outperforms strong baselines by a large margin. Extensive analyses validate the effectiveness and generalization of MSDP.
- 21 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 430-440
Open AccessA Multi-Task Semantic Decomposition Framework with Task-specific Pre-training for Few-Shot NER
The objective of few-shot named entity recognition is to identify named entities with limited labeled instances. Previous works have primarily focused on optimizing the traditional token-wise classification framework, while neglecting the exploration of information based on NER data characteristics. To address this issue, we propose a Multi-Task Semantic Decomposition Framework via Joint Task-specific Pre-training (MSDP) for few-shot NER. Drawing inspiration from demonstration-based and contrastive learning, we introduce two novel pre-training tasks: Demonstration-based Masked Language Modeling (MLM) and Class Contrastive Discrimination. These tasks effectively incorporate entity boundary information and enhance entity representation in Pre-trained Language Models (PLMs). In the downstream main task, we introduce a multi-task joint optimization framework with the semantic decomposing method, which facilitates the model to integrate two different semantic information for entity classification. Experimental results of two few-shot NER benchmarks demonstrate that MSDP consistently outperforms strong baselines by a large margin. Extensive analyses validate the effectiveness and generalization of MSDP.