MiCEval: Unveiling Multimodal Chain of Thought’s Quality via Image Description and Reasoning Steps
Open Access
- 1 January 2025
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 10002-10039
Abstract
Xiongtao Zhou, Jie He, Lanyu Chen, Jingyu Li, Haojing Chen, Victor Gutierrez Basulto, Jeff Z. Pan, Hanjie Chen. Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2025.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Evaluating Mathematical Reasoning Beyond AccuracyProceedings of the AAAI Conference on Artificial Intelligence, 2025
- Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs2024
- G-Eval: NLG Evaluation using Gpt-4 with Better Human Alignment2023
- ReCEval: Evaluating Reasoning Chains via Correctness and Informativeness2023
- Uncovering Implicit Inferences for Improved Relational Argument Mining2023
- Making Language Models Better Reasoners with Step-Aware Verifier2023
- Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanations2022
- CLIPScore: A Reference-free Evaluation Metric for Image Captioning2021
- A Study of Automatic Metrics for the Evaluation of Natural Language Explanations2021
- Learning Typed Entailment Graphs with Global Soft ConstraintsTransactions of the Association for Computational Linguistics, 2018