Scientific document processing: challenges for modern learning methods
Open Access
- 24 March 2023
- journal article
- research article
- Published by Springer Nature in International Journal on Digital Libraries
- Vol. 24 (4) , 283-309
Abstract
Neural network models enjoy success on language tasks related to Web documents, including news and Wikipedia articles. However, the characteristics of scientific publications pose specific challenges that have yet to be satisfactorily addressed: the discourse structure of scientific documents crucial in scholarly document processing (SDP) tasks, the interconnected nature of scientific documents, and their multimodal nature. We survey modern neural network learning methods that tackle these challenges: those that can model discourse structure and their interconnectivity and use their multimodal nature. We also highlight efforts to collect large-scale datasets and tools developed to enable effective deep learning deployment for SDP. We conclude with a discussion on upcoming trends and recommend future directions for pursuing neural natural language processing approaches for SDP.Keywords
This publication has 166 references indexed in Scilit:
- Recent applications of Knowledge Organization Systems: introduction to a special issueInternational Journal on Digital Libraries, 2015
- Summarization of scientific documents by detecting common facts in citationsFuture Generation Computer Systems, 2014
- Glove: Global Vectors for Word Representation2014
- Automatic Keyphrase Extraction: A Survey of the State of the Art2014
- Temporal Effects in the Growth of NetworksPhysical Review Letters, 2011
- Logical Structure Recovery in Scholarly Articles with Rich Document FeaturesInternational Journal of Digital Library Systems, 2010
- The Structure of a Scientific PaperPhilosophy of Science, 1998
- Long Short-Term MemoryNeural Computation, 1997
- National Digital Library of Theses and DissertationsD-Lib Magazine, 1996
- Constructing Mental Models of Machines from Text and DiagramsJournal of Memory and Language, 1993