A Survey of Pretrained Language Models
Authors:
- 19 July 2022
- book chapter
- Published by Springer Nature
- p. 442-456
Abstract
No abstract availableKeywords
This publication has 26 references indexed in Scilit:
- Joint extraction of entities and relations based on character graph convolutional network and Multi-Head Self-Attention MechanismJournal of Experimental & Theoretical Artificial Intelligence, 2020
- Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) networkPhysica D: Nonlinear Phenomena, 2020
- An attention mechanism and multi-granularity-based Bi-LSTM model for Chinese Q&A systemSoft Computing, 2019
- ERNIE: Enhanced Language Representation with Informative Entities2019
- Transformer-XL: Attentive Language Models beyond a Fixed-Length Context2019
- GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding2018
- Deep Contextualized Word Representations2018
- Glove: Global Vectors for Word Representation2014
- Transfer Learning2010
- Long Short-Term MemoryNeural Computation, 1997