NYTWIT: A Dataset of Novel Words in the New York Times
Authors:
- Yuval PinterYPYuval Pinter
- Cassandra L. JacobsCJCassandra L. Jacobs
- Max BittkerMBMax Bittker
Preprint
Abstract
We present the New York Times Word Innovation Types dataset, or NYTWIT, a collection of over 2,500 novel English words published in the New York Times between November 2017 and March 2019, manually annotated for their class of novelty (such as lexical derivation, dialectal variation, blending, or compounding). We present baseline results for both uncontextual and contextual prediction of novelty class, showing that there is room for improvement even for state-of-the-art NLP systems. We hope this resource will prove useful for linguists and NLP practitioners by providing a real-world environment of novel word appearance.Keywords
All Related Versions
This publication has 3 references indexed in Scilit:
- Twitterverse: The birth of new wordsProceedings of the Linguistic Society of America, 2019
- Recent Trends in Deep Learning Based Natural Language Processing [Review Article]IEEE Computational Intelligence Magazine, 2018
- Automatically Identifying the Source Words of Lexical Blends in EnglishComputational Linguistics, 2010