Word-Centered Semantic Graphs for Interpretable Diachronic Sense Tracking
Preprint
Abstract
We propose an interpretable, graph-based framework for analyzing semantic shift in diachronic corpora. For each target word and time slice, we induce a word-centered semantic network that integrates distributional similarity from diachronic Skip-gram embeddings with lexical substitutability from time-specific masked language models. We identify sense-related structure by clustering the peripheral graph, align clusters across time via node overlap, and track change through cluster composition and normalized cluster mass. In an application study on a corpus of New York Times Magazine articles (1980 - 2017), we show that graph connectivity reflects polysemy dynamics and that the induced communities capture contrasting trajectories: event-driven sense replacement (trump), semantic stability with cluster over-segmentation effects (god), and gradual association shifts tied to digital communication (post). Overall, word-centered semantic graphs offer a compact and transparent representation for exploring sense evolution without relying on predefined sense inventories.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Lexical Semantic Change through Large Language Models: a SurveyACM Computing Surveys, 2024
- Topological properties and organizing principles of semantic networksScientific Reports, 2023
- Using neural topic models to track context shifts of words: a case study of COVID-related terms before and after the lockdown in April 20202022
- Representations of Meaning in Neural Networks for NLP: a Thesis Proposal2021
- SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection2020
- SST-BERT at SemEval-2020 Task 1: Semantic Shift Tracing by Clustering in BERT-based Embedding Spaces2020
- Analysing Lexical Semantic Change with Contextualised Word Representations2020
- Improving Distributional Similarity with Lessons Learned from Word EmbeddingsTransactions of the Association for Computational Linguistics, 2015
- "I Don’t Believe in Word Senses"Computers and the Humanities, 1997
- WordNetCommunications of the ACM, 1995