Abstract
Recently published graph neural networks (GNNs) show promising performance at social event detection tasks. However, most studies are oriented toward monolingual data in languages with abundant training samples. This has left the common lesser-spoken languages relatively unexplored. Thus, in this work, we present a GNN-based framework that integrates cross-lingual word embeddings into the process of graph knowledge distillation for detecting events in low-resource language data streams. To achieve this, a novel cross-lingual knowledge distillation framework, called CLKD, exploits prior knowledge learned from similar threads in English to make up for the paucity of annotated data. Specifically, to extract sufficient useful knowledge, we propose a hybrid distillation method that consists of both feature-wise and relation-wise information. To transfer both kinds of knowledge in an effective way, we add a cross-lingual module in the feature-wise distillation to eliminate the language gap and selectively choose beneficial relations in the relation-wise distillation to avoid distraction caused by teachers’ misjudgments. Our proposed CLKD framework also adopts different configurations to suit both offline and online situations. Experiments on real-world datasets show that the framework is highly effective at detection in languages where training samples are scarce.
Funding Information
  • National Key R&D Program of China (2022YFB3104703)
  • NSFC (62322202, U21B2027, 61972186, 62266028, and 62432006)
  • Beijing Natural Science Foundation (4222030)
  • Guangdong Basic and Applied Basic Research Foundation (2023B1515120020)
  • Local Science and Technology Development Fund of Hebei Province Guided by the Central Government of China (246Z0102G)
  • Yunnan Provincial Major Science and Technology Special Plan Projects (202302AD080003, 202202AD080003 and 202303AP140008)
  • General Projects of Basic Research in Yunnan Province (202301AS070047, 202301AT070471)
  • Australian Research Council (DP230100899)