Assessing Color Vision Test in Large Vision-language Models
Preprint
Abstract
With the widespread adoption of large vision-language models, the capacity for color vision in these models is crucial. However, the color vision abilities of large visual-language models have not yet been thoroughly explored. To address this gap, we define a color vision testing task for large vision-language models and construct a dataset \footnote{Anonymous Github Showing some of the data https://anonymous.4open.science/r/color-vision-test-dataset-3BCD} that covers multiple categories of test questions and tasks of varying difficulty levels. Furthermore, we analyze the types of errors made by large vision-language models and propose fine-tuning strategies to enhance their performance in color vision tests.Keywords
All Related Versions
This publication has 5 references indexed in Scilit:
- MMBench: Is Your Multi-modal Model an All-Around Player?2024
- DriveGPT4: Interpretable End-to-End Autonomous Driving Via Large Language ModelIEEE Robotics and Automation Letters, 2024
- Large language model to multimodal large language model: A journey to shape the biological macromolecules to biological sciences and medicineMolecular Therapy Nucleic Acids, 2024
- Scientific figures interpreted by ChatGPT: strengths in plot recognition and limits in color perceptionnpj Precision Oncology, 2024
- MVP-Bench: Can Large Vision-Language Models Conduct Multi-level Visual Perception Like Humans?2024