SciPostLayout: A Dataset for Layout Analysis and Layout Generation of Scientific Posters
Preprint
Abstract
Scientific posters are used to present the contributions of scientific papers effectively in a graphical format. However, creating a well-designed poster that efficiently summarizes the core of a paper is both labor-intensive and time-consuming. A system that can automatically generate well-designed posters from scientific papers would reduce the workload of authors and help readers understand the outline of the paper visually. Despite the demand for poster generation systems, only a limited research has been conduced due to the lack of publicly available datasets. Thus, in this study, we built the SciPostLayout dataset, which consists of 7,855 scientific posters and manual layout annotations for layout analysis and generation. SciPostLayout also contains 100 scientific papers paired with the posters. All of the posters and papers in our dataset are under the CC-BY license and are publicly available. As benchmark tests for the collected dataset, we conducted experiments for layout analysis and generation utilizing existing computer vision models and found that both layout analysis and generation of posters using SciPostLayout are more challenging than with scientific papers. We also conducted experiments on generating layouts from scientific papers to demonstrate the potential of utilizing LLM as a scientific poster generation system. The dataset is publicly available at https://huggingface.co/datasets/omron-sinicx/scipostlayout_v2. The code is also publicly available at https://github.com/omron-sinicx/scipostlayout.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Constrained Graphic Layout Generation via Latent Optimization2021
- Modeling Visual Containment for Web Page Layout OptimizationComputer Graphics Forum, 2021
- Attribute-Conditioned Layout GAN for Automatic Graphic DesignIEEE Transactions on Visualization and Computer Graphics, 2020
- DocBank: A Benchmark Dataset for Document Layout Analysis2020
- PubLayNet: Largest Dataset Ever for Document Layout Analysis2019
- Content-aware generative modeling of graphic design layoutsACM Transactions on Graphics, 2019
- Learning to Generate Posters of Scientific Papers by Probabilistic Graphical ModelsJournal of Computer Science and Technology, 2019
- Visual Detection with Context for Document Layout Analysis2019
- Tailored Summary for automatic poster generator2017