Mining the Web for New Words: Semi-Automatic Neologism Identification with the NeoCrawler
Authors:
- 11 June 2018
- journal article
- research article
- Published by Walter de Gruyter GmbH in angl
- Vol. 136 (2) , 239-268
Abstract
Lexical innovation is omnipresent and constantly at work. Studies aiming to understand the process of lexical innovation and the subsequent diffusion of neologisms therefore benefit from systematic methods of neologism identification. Retrieval procedures in the past have largely consisted of manual activities of participant observations and close reading. Recently, attempts have been made at designing automatized identification procedures, assisted by state-of-the-art natural language processing techniques and tools. Beginning with a discussion of the most commonly used neologism detection methods and applications in linguistics, the present paper will describe a semi-automatic approach to identifying new words on the web, the NeoCrawler’s Discoverer, which has been developed as part of a project on the incipient diffusion of lexical innovations. The Discoverer daily processes large batches of online text in English and automatically identifies unknown grapheme sequences as potential neologism candidates by means of a dictionary matching procedure, in which the individual tokens are matched against a very large dictionary. These potential neologisms subsequently are presented to the user for manual evaluation of their neologism status. Finally, candidates are added to the NeoCrawler’s database for continuous close monitoring of their development in the online speech community. We argue that the use of dictionary matching in neologism identification offers an efficient method to semi-automatically extract potential instances of lexical innovation with high precision and high recall when compared to previous approaches.Keywords
This publication has 12 references indexed in Scilit:
- Improved New Word Detection Method Used in Tourism FieldProcedia Computer Science, 2017
- Character Based Pattern Mining for Neology Detection2017
- Diachronic Word Embeddings Reveal Statistical Laws of Semantic Change2016
- Making Decisions about Inclusion and Exclusion2015
- 6. A Web of New Words. A Corpus-Based Study of the Conventionalization Process of English NeologismsEnglish and American Studies in German, 2015
- Building the Interface between Experts and Linguists in the Detection and characterisation of Neology in the Field of Neurosciences2014
- Using Web-Based Corpora to Find Norwegian Specialised NeologiesCommunication & Language at Work, 2012
- The NeoCrawler: identifying and retrieving neologisms from the internet and monitoring ongoing change2011
- Comparison of selected methods for the retrieval of neologismsInvestigationes Linguisticae, 2008
- Contextual Clues to Word-MeaningCorpus Studies of Language Through Time, 2000