Real-Time Visual Feedback to Guide Benchmark Creation: A Human-and-Metric-in-the-Loop Workflow
Open Access
- 1 January 2023
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 2899-2927
Abstract
Anjana Arunkumar, Swaroop Mishra, Bhavdeep Singh Sachdeva, Chitta Baral, Chris Bryan. Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics. 2023.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- Adversarial NLI: A New Benchmark for Natural Language Understanding2020
- Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics2020
- Trick Me If You Can: Human-in-the-Loop Generation of Adversarial Examples for Question AnsweringTransactions of the Association for Computational Linguistics, 2019
- BioBERT: a pre-trained biomedical language representation model for biomedical text miningBioinformatics, 2019
- An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction2019
- How Much Reading Does Reading Comprehension Require? A Critical Investigation of Popular Benchmarks2018
- Ordinal Common-sense InferenceTransactions of the Association for Computational Linguistics, 2017
- SQuAD: 100,000+ Questions for Machine Comprehension of Text2016
- Comparing the understandability of alternative data warehouse schemas: An empirical studyDecision Support Systems, 2011
- Pair Analytics: Capturing Reasoning Processes in Collaborative Visual Analytics2011