MLAN: Language-Based Instruction Tuning Preserves and Transfers Knowledge in Multimodal Language Models
Open Access
- 1 January 2025
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 59-74
Abstract
Jianhong Tu, Zhuohao Ni, Nicholas Crispino, Zihao Yu, Michael Bendersky, Beliz Gunel, Ruoxi Jia, Xin Liu, Lingjuan Lyu, Dawn Song, Chenguang Wang. Proceedings of the 3rd Workshop on Towards Knowledgeable Foundation Models (KnowFM). 2025.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction Tuning2025
- Filter Images First, Generate Instructions Later: Pre-Instruction Data Selection for Visual Instruction Tuning2025
- Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Models2025
- ShareGPT4V: Improving Large Multi-modal Models with Better Captions2024
- Improved Baselines with Visual Instruction Tuning2024
- MMMU: A Massive Multi-Discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI2024
- VILA: On Pre-training for Visual Language Models2024
- Florence-2: Advancing a Unified Representation for a Variety of Vision Tasks2024
- Visual Instruction Tuning with Polite FlamingoProceedings of the AAAI Conference on Artificial Intelligence, 2024
- MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning2023