Lexical Semantic Change through Large Language Models: a Survey
Top Cited Papers
Open Access
- 29 June 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 56 (11) , 1-38
Abstract
Lexical Semantic Change (LSC) is the task of identifying, interpreting, and assessing the possible change over time in the meanings of a target word. Traditionally, LSC has been addressed by linguists and social scientists through manual and time-consuming analyses, which have thus been limited in terms of the volume, genres, and time-frame that can be considered. In recent years, computational approaches based on Natural Language Processing have gained increasing attention to automate LSC as much as possible. Significant advancements have been made by relying on Large Language Models (LLMs), which can handle the multiple usages of the words and better capture the related semantic change. In this article, we survey the approaches based on LLMs for LSC, and we propose a classification framework characterized by three dimensions: meaning representation , time-awareness , and learning modality . The framework is exploited to (i) review the measures for change assessment, (ii) compare the approaches on performance, and (iii) discuss the current issues in terms of scalability, interpretability, and robustness. Open challenges and future research directions about the use of LLMs for LSC are finally outlined.Keywords
All Related Versions
This publication has 120 references indexed in Scilit:
- Let’s PlayMono-Poly: BERT Can Reveal Words’ Polysemy Level and Partitionability into SensesTransactions of the Association for Computational Linguistics, 2021
- ELMo and BERT in Semantic Change Detection for Russian2021
- 2. Contact-induced change2019
- Language History, Language Change, and Language Relationship2019
- A state-of-the-art of semantic change computationNatural Language Engineering, 2018
- Displacement interpolation using Lagrangian mass transportACM Transactions on Graphics, 2011
- Political correctness, euphemism, and language change: The case of ‘people first’Journal of Pragmatics, 2011
- Correlation ClusteringMachine Learning, 2004
- Prinzipien des lexikalischen Bedeutungswandels am Beispiel der romanischen Sprachen1997
- Silhouettes: A graphical aid to the interpretation and validation of cluster analysisJournal of Computational and Applied Mathematics, 1987