Morphological Analysis Using a Sequence Decoder
Authors:
Open Access
- 1 November 2019
- journal article
- research article
- Published by MIT Press in Transactions of the Association for Computational Linguistics
- Vol. 7, 567-579
Abstract
We introduce Morse, a recurrent encoder-decoder model that produces morphological analyses of each word in a sentence. The encoder turns the relevant information about the word and its context into a fixed size vector representation and the decoder generates the sequence of characters for the lemma followed by a sequence of individual morphological features. We show that generating morphological features individually rather than as a combined tag allows the model to handle rare or unseen tags and to outperform whole-tag models. In addition, generating morphological features as a sequence rather than, for example, an unordered set allows our model to produce an arbitrary number of features that represent multiple inflectional groups in morphologically complex languages. We obtain state-of-the-art results in nine languages of different morphological complexity under low-resource, high-resource, and transfer learning settings. We also introduce TrMor2018, a new high-accuracy Turkish morphology data set. Our Morse implementation and the TrMor2018 data set are available online to support future research. 1 See https://github.com/ai-ku/Morse.jl for a Morse implementation in Julia/Knet (Yuret, 2016 ) and https://github.com/ai-ku/TrMor2018 for the new Turkish data set.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Neural Factor Graph Models for Cross-lingual Morphological Tagging2018
- Turkish Natural Language Processing2018
- Character-Aware Neural Morphological Disambiguation2017
- Cross-lingual Character-Level Neural Morphological Tagging2017
- Joint Lemmatization and Morphological Tagging with Lemming2015
- Dependency Parsing of TurkishComputational Linguistics, 2008
- Statistical Morphological Disambiguation for Agglutinative LanguagesComputers and the Humanities, 2002
- Constraint Grammar1995
- Tagging and morphological disambiguation of Turkish text1994
- Two-level Description of Turkish MorphologyLiterary and Linguistic Computing, 1994