IPC prediction of patent documents using neural network with attention for hierarchical structure
Authors:
Open Access
- 2 March 2023
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 18 (3) , e0282361
Abstract
International patent classifications (IPCs) are assigned to patent documents; however, since the procedure for assigning classifications is manually done by the patent examiner, it takes a lot of time and effort to select some IPCs from about 70,000 IPCs. Hence, some research has been conducted on patent classification with machine learning. However, patent documents are very voluminous, and learning with all the claims (the part describing the content of the patent) as input would run out of the necessary memory, even if the batch size is set to a very small size. Therefore, most of the existing methods learn by excluding some information, such as using only the first claim as input. In this study, we propose a model that considers the contents of all claims by extracting important information for input. In addition, we focus on the hierarchical structure of the IPC, and propose a new decoder architecture to consider it. Finally, we conducted an experiment using actual patent data to verify the accuracy of the prediction. The results showed a significant improvement in accuracy compared to existing methods, and the actual applicability of the method was also discussed.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Two-Stream Convolution Augmented Transformer for Human Activity RecognitionProceedings of the AAAI Conference on Artificial Intelligence, 2021
- Attention-Based Deep Learning Framework for Human Activity Recognition With User AdaptationIEEE Sensors Journal, 2021
- Patent classification by fine-tuning BERT language modelWorld Patent Information, 2020
- Hierarchical Multi-label Text Classification2019
- DeepPatent: patent classification with convolutional neural networks and word embeddingScientometrics, 2018
- Automated Patent Classification Using Word Embedding2017
- Long Short-Term Memory-Networks for Machine Reading2016
- Large-Scale Multi-label Text Classification — Revisiting Neural Networks2014
- Decision trees for hierarchical multi-label classificationMachine Learning, 2008
- Automated categorization in the international patent classificationACM SIGIR Forum, 2003