Vinay Samuel
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Vinay Samuel has a total of 13 co-authors. Here are the top co-authors by number of shared publications:
- Shahriar Noroozizadeh
Machine Learning Department Carnegie Mellon University Carnegie Mellon University Carnegie Mellon University
2 shared publications - Spandan Das
Machine Learning Department Carnegie Mellon University Carnegie Mellon University Carnegie Mellon University
2 shared publications Aman Chadha
Amazon GenAI
1 shared publicationArijit Chowdhury
University of Illinois Urbana-Champaign
1 shared publication- Cornelia Caragea
Computer Science University of Illinois Chicago
1 shared publication Henry Zou
University of Illinois Chicago
1 shared publication
Latest Publications
- Open Access
TLDR at SemEval-2024 Task 2: T5-generated clinical-Language summaries for DeBERTa Report Analysis
This paper introduces novel methodologies for the Natural Language Inference for Clinical Trials (NLI4CT) task. We present TLDR (T5-generated clinical-Language summaries for DeBERTa Report Analysis) which incorporates T5-model generated premise summaries for improved entailment and contradiction analysis in clinical NLI tasks. This approach overcomes the challenges posed by small context windows and lengthy premises, leading to a substantial improvement in Macro F1 scores: a 0.184 increase over truncated premises. Our comprehensive experimental evaluation, including detailed error analysis and ablations, confirms the superiority of TLDR in achieving consistency and faithfulness in predictions against semantically altered inputs.
Open AccessTLDR at SemEval-2024 Task 2: T5-generated clinical-Language summaries for DeBERTa Report Analysis
This paper introduces novel methodologies for the Natural Language Inference for Clinical Trials (NLI4CT) task. We present TLDR (T5-generated clinical-Language summaries for DeBERTa Report Analysis) which incorporates T5-model generated premise summaries for improved entailment and contradiction analysis in clinical NLI tasks. This approach overcomes the challenges posed by small context windows and lengthy premises, leading to a substantial improvement in Macro F1 scores: a 0.184 increase over truncated premises. Our comprehensive experimental evaluation, including detailed error analysis and ablations, confirms the superiority of TLDR in achieving consistency and faithfulness in predictions against semantically altered inputs.
- Open Access
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 338-354
ImplicitAVE: An Open-Source Dataset and Multimodal LLMs Benchmark for Implicit Attribute Value Extraction
Henry Zou, Vinay Samuel, Yue Zhou, Weizhi Zhang, Liancheng Fang, Zihe Song, Philip Yu, Cornelia Caragea. Findings of the Association for Computational Linguistics ACL 2024. 2024.
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 338-354
Open AccessImplicitAVE: An Open-Source Dataset and Multimodal LLMs Benchmark for Implicit Attribute Value Extraction
Henry Zou, Vinay Samuel, Yue Zhou, Weizhi Zhang, Liancheng Fang, Zihe Song, Philip Yu, Cornelia Caragea. Findings of the Association for Computational Linguistics ACL 2024. 2024.
- Open Access
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 411-421
Can LLMs Augment Low-Resource Reading Comprehension Datasets? Opportunities and Challenges
Vinay Samuel, Houda Aynaou, Arijit Chowdhury, Karthik Venkat Ramanan, Aman Chadha. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop). 2024.
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 411-421
Open AccessCan LLMs Augment Low-Resource Reading Comprehension Datasets? Opportunities and Challenges
Vinay Samuel, Houda Aynaou, Arijit Chowdhury, Karthik Venkat Ramanan, Aman Chadha. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop). 2024.
- Open Access
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 520-529
TLDR at SemEval-2024 Task 2: T5-generated clinical-Language summaries for DeBERTa Report Analysis
Spandan Das, Vinay Samuel, Shahriar Noroozizadeh. Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024). 2024.
- 1 January 2024
- Published by Association for Computational Linguistics (ACL)
- p. 520-529
Open AccessTLDR at SemEval-2024 Task 2: T5-generated clinical-Language summaries for DeBERTa Report Analysis
Spandan Das, Vinay Samuel, Shahriar Noroozizadeh. Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024). 2024.