Evaluation Examples are not Equally Informative: How should that change NLP Leaderboards?

Authors:
  • PRPedro Rodriguez
    Pedro Rodriguez
  • JBJoe Barrow
    Joe Barrow
  • AHAlexander Miserlis Hoyle
    Alexander Miserlis Hoyle
  • JLJohn P. Lalor
    John P. Lalor
  • RJRobin Jia
    Robin Jia
  • JBJordan Boyd-Graber
    Jordan Boyd-Graber

Top Cited Papers
Open Access
Abstract
Pedro Rodriguez, Joe Barrow, Alexander Miserlis Hoyle, John P. Lalor, Robin Jia, Jordan Boyd-Graber. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.