RoKEPG: RoBERTa and Knowledge Enhancement for Prescription Generation of Traditional Chinese Medicine
Preprint
Abstract
Traditional Chinese medicine (TCM) prescription is the most critical form of TCM treatment, and uncovering the complex nonlinear relationship between symptoms and TCM is of great significance for clinical practice and assisting physicians in diagnosis and treatment. Although there have been some studies on TCM prescription generation, these studies consider a single factor and directly model the symptom-prescription generation problem mainly based on symptom descriptions, lacking guidance from TCM knowledge. To this end, we propose a RoBERTa and Knowledge Enhancement model for Prescription Generation of Traditional Chinese Medicine (RoKEPG). RoKEPG is firstly pre-trained by our constructed TCM corpus, followed by fine-tuning the pre-trained model, and the model is guided to generate TCM prescriptions by introducing four classes of knowledge of TCM through the attention mask matrix. Experimental results on the publicly available TCM prescription dataset show that RoKEPG improves the F1 metric by about 2% over the baseline model with the best results.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- A novel transfer learning model for traditional herbal medicine prescription generation from unstructured resources and knowledgeArtificial Intelligence in Medicine, 2022
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension2020
- Exploration on Generating Traditional Chinese Medicine Prescriptions from Symptoms with an End-to-End Approach2019
- AttentiveHerb: A Novel Method for Traditional Medicine Prescription GenerationIEEE Access, 2019
- A Topic Modeling Approach for Traditional Chinese Medicine PrescriptionsIEEE Transactions on Knowledge and Data Engineering, 2018
- Analyzing user-generated online content for drug discovery: development and use of MedCrawlerBioinformatics, 2016
- Classifier chains for multi-label classificationMachine Learning, 2011
- ML-KNN: A lazy learning approach to multi-label learningPattern Recognition, 2007
- Learning multi-label scene classificationPattern Recognition, 2004