Deduplicating Training Data Makes Language Models Better

Authors:
  • KLKatherine Lee
    Katherine Lee
  • DIDaphne Ippolito
    Daphne Ippolito
  • ANAndrew Nystrom
    Andrew Nystrom
  • CZChiyuan Zhang
    Chiyuan Zhang
  • DEDouglas Eck
    Douglas Eck
  • CCChris Callison-Burch
    Chris Callison-Burch
  • NCNicholas Carlini
    Nicholas Carlini
Top Cited Papers
Open Access
Publisher website
Google Scholar
Abstract
Katherine Lee, Daphne Ippolito, Andrew Nystrom, Chiyuan Zhang, Douglas Eck, Chris Callison-Burch, Nicholas Carlini. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2022.