AutoTriggER: Named Entity Recognition with Auxiliary Trigger Extraction

Authors:
  • DLDong-Ho Lee
    Dong-Ho Lee
  • RSRavi Kiran Selvam
    Ravi Kiran Selvam
  • SSSheikh Muhammad Sarwar
    Sheikh Muhammad Sarwar
  • BLBill Yuchen Lin
    Bill Yuchen Lin
  • MAMahak Agarwal
    Mahak Agarwal
  • FMFred Morstatter
    Fred Morstatter
  • JPJay Pujara
    Jay Pujara
  • EBElizabeth Boschee
    Elizabeth Boschee
  • JAJames Allan
    James Allan
  • XRXiang Ren
    Xiang Ren

Abstract
Deep neural models for low-resource named entity recognition (NER) have shown impressive results by leveraging distant super-vision or other meta-level information (e.g. explanation). However, the costs of acquiring such additional information are generally prohibitive, especially in domains where existing resources (e.g. databases to be used for distant supervision) may not exist. In this paper, we present a novel two-stage framework (AutoTriggER) to improve NER performance by automatically generating and leveraging "entity triggers" which are essentially human-readable clues in the text that can help guide the model to make better decisions. Thus, the framework is able to both create and leverage auxiliary supervision by itself. Through experiments on three well-studied NER datasets, we show that our automatically extracted triggers are well-matched to human triggers, and AutoTriggER improves performance over a RoBERTa-CRFarchitecture by nearly 0.5 F1 points on average and much more in a low resource setting.