Yunziwei Deng
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Yunziwei Deng has a total of 4 co-authors. Here are the top co-authors by number of shared publications:
- Linjie Wang
Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing 100094, China
1 shared publication - Shengyang Li
Chinese Academy of Sciences
1 shared publication - Shiyi Hao
Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing 100094, China
1 shared publication - Yunfei Liu
Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing, China
1 shared publication
Latest Publications
- Open Access
- 26 July 2024
- Published by MDPI AG in Electronics
- Vol. 13 (15) , 2949
SSuieBERT: Domain Adaptation Model for Chinese Space Science Text Mining and Information Extraction
With the continuous exploration of space science, a large number of domain-related materials and scientific literature are constantly generated, mostly in the form of text, which contains rich and unexplored domain knowledge. Natural language processing technology has made rapid development and pre-trained language models provide promising information extraction tools. However, due to the strong professionalism of space science, there are many domain concepts and technical terms. Moreover, Chinese texts have complex language structures and word combinations, which may yield suboptimal performance by general pre-trained models such as BERT. In this work, we investigate how to adapt BERT to Chinese space science and propose the space science-aware pre-trained language model, namely, SSuieBERT. We validate it through downstream tasks such as named entity recognition, relation extraction, and event extraction, which can perform better than general models. To the best of our knowledge, our proposed SSuieBERT is the first pre-trained language model in space science, which can promote information extraction and knowledge discovery from space science texts.
- 26 July 2024
- Published by MDPI AG in Electronics
- Vol. 13 (15) , 2949
Open AccessSSuieBERT: Domain Adaptation Model for Chinese Space Science Text Mining and Information Extraction
With the continuous exploration of space science, a large number of domain-related materials and scientific literature are constantly generated, mostly in the form of text, which contains rich and unexplored domain knowledge. Natural language processing technology has made rapid development and pre-trained language models provide promising information extraction tools. However, due to the strong professionalism of space science, there are many domain concepts and technical terms. Moreover, Chinese texts have complex language structures and word combinations, which may yield suboptimal performance by general pre-trained models such as BERT. In this work, we investigate how to adapt BERT to Chinese space science and propose the space science-aware pre-trained language model, namely, SSuieBERT. We validate it through downstream tasks such as named entity recognition, relation extraction, and event extraction, which can perform better than general models. To the best of our knowledge, our proposed SSuieBERT is the first pre-trained language model in space science, which can promote information extraction and knowledge discovery from space science texts.