Jianjian Sun
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Jianjian Sun has a total of 15 co-authors. Here are the top co-authors by number of shared publications:
- Zheng Ge
Megvii Technology, Beijing, China
2 shared publications - Chenglong Liu
Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, China
1 shared publication - Chunrui Han
Megvii Technology, Beijing, China
1 shared publication - Daxin Jiang
StepFun, Shanghai, China
1 shared publication - Hanpeng Hu
StepFun, Shanghai, China
1 shared publication - Haoran Wei
Megvii Technology
1 shared publication
Latest Publications
- Open Access
- 27 August 2025
- Published by Association for Computing Machinery (ACM)
- p. 24-38
DistTrain: Addressing Model and Data Heterogeneity with Disaggregated Training for Multimodal Large Language Models
- 27 August 2025
- Published by Association for Computing Machinery (ACM)
- p. 24-38
Open AccessDistTrain: Addressing Model and Data Heterogeneity with Disaggregated Training for Multimodal Large Language Models
- Open Access
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 147-155
OneChart: Purify the Chart Structural Extraction via One Auxiliary Token
Chart parsing poses a significant challenge due to the diversity of styles, values, texts, and so forth. Even advanced large vision-language models (LVLMs) with billions of parameters struggle to handle such tasks satisfactorily. To address this, we propose OneChart: a reliable agent specifically devised for the structural extraction of chart information. Similar to popular LVLMs, OneChart incorporates an autoregressive main body. Uniquely, to enhance the reliability of the numerical parts of the output, we introduce an auxiliary token placed at the beginning of the total tokens along with an additional decoder. The numerically optimized (auxiliary) token allows subsequent tokens for chart parsing to capture enhanced numerical features through causal attention. Furthermore, with the aid of the auxiliary token, we have devised a self-evaluation mechanism that enables the model to gauge the reliability of its chart parsing results by providing confidence scores for the generated content. Compared to current state-of-the-art (SOTA) chart parsing models, e.g., DePlot, ChartVLM, ChartAst, OneChart significantly outperforms in Average Precision (AP) for chart structural extraction across multiple public benchmarks, despite enjoying only 0.2 billion parameters. Moreover, as a chart parsing agent, it also brings 10%+ accuracy gains for the popular LVLM (LLaVA-1.6) in the downstream ChartQA benchmark. Our code, model and datasets ara available at https://onechartt.github.io.
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 147-155
Open AccessOneChart: Purify the Chart Structural Extraction via One Auxiliary Token
Chart parsing poses a significant challenge due to the diversity of styles, values, texts, and so forth. Even advanced large vision-language models (LVLMs) with billions of parameters struggle to handle such tasks satisfactorily. To address this, we propose OneChart: a reliable agent specifically devised for the structural extraction of chart information. Similar to popular LVLMs, OneChart incorporates an autoregressive main body. Uniquely, to enhance the reliability of the numerical parts of the output, we introduce an auxiliary token placed at the beginning of the total tokens along with an additional decoder. The numerically optimized (auxiliary) token allows subsequent tokens for chart parsing to capture enhanced numerical features through causal attention. Furthermore, with the aid of the auxiliary token, we have devised a self-evaluation mechanism that enables the model to gauge the reliability of its chart parsing results by providing confidence scores for the generated content. Compared to current state-of-the-art (SOTA) chart parsing models, e.g., DePlot, ChartVLM, ChartAst, OneChart significantly outperforms in Average Precision (AP) for chart structural extraction across multiple public benchmarks, despite enjoying only 0.2 billion parameters. Moreover, as a chart parsing agent, it also brings 10%+ accuracy gains for the popular LVLM (LLaVA-1.6) in the downstream ChartQA benchmark. Our code, model and datasets ara available at https://onechartt.github.io.