Improving Model Evaluation using SMART Filtering of Benchmark Datasets

Authors:

Open Access

1 January 2025

conference paper
Published by Association for Computational Linguistics (ACL)

p. 4595-4615
DOI:10.18653/v1/2025.naacl-long.235

Abstract

Vipul Gupta, Candace Ross, David Pantoja, Rebecca J. Passonneau, Megan Ung, Adina Williams. Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2025.

Keywords

All Related Versions

This publication has 38 references indexed in Scilit:

Efficient Methods for Natural Language Processing: A Survey
Transactions of the Association for Computational Linguistics, 2023
Mapping global dynamics of benchmark creation and saturation in artificial intelligence
Nature Communications, 2022
A Survey on Cost Types, Interaction Schemes, and Annotator Performance Models in Selection Algorithms for Active Learning in Classification
IEEE Access, 2021
DynaSent: A Dynamic Benchmark for Sentiment Analysis
2021
Automatic Detection of Machine Generated Text: A Critical Survey
2020
What do we expect from Multiple-choice QA Systems?
2020
Do We Need to Create Big Datasets to Learn a Task?
2020
Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics
2020
Adversarial NLI: A New Benchmark for Natural Language Understanding
2020
A NEW MEASURE OF RANK CORRELATION
Biometrika, 1938