Story Generation from Visual Inputs: Techniques, Related Tasks, and Challenges
Open Access
- 18 September 2025
- journal article
- research article
- Published by MDPI AG in Information
- Vol. 16 (9) , 812
Abstract
Creating engaging narratives from visual data is crucial for automated digital media consumption, assistive technologies, and interactive entertainment. This survey covers methodologies used in the generation of these narratives, focusing on their principles, strengths, and limitations. The survey also covers tasks related to automatic story generation, such as image and video captioning, and Visual Question Answering. These tasks share common challenges with Visual Story Generation (VSG) and have served as inspiration for the techniques used in the field. We analyze the main datasets and evaluation metrics, providing a critical perspective on their limitations.Keywords
All Related Versions
Funding Information
- Fundação para a Ciência e Tecnologia (FCT) (2021.06750.BD, UIDB/50021/2020)
- Portuguese National Funds through FCT (2021.06750.BD, UIDB/50021/2020)
This publication has 47 references indexed in Scilit:
- ChatGPT outperforms crowd workers for text-annotation tasksProceedings of the National Academy of Sciences, 2023
- AOG-LSTM: An adaptive attention neural network for visual storytellingNeurocomputing, 2023
- Visual Writing Prompts: Character-Grounded Story Generation with Curated Image SequencesTransactions of the Association for Computational Linguistics, 2023
- Coherent Visual Storytelling via Parallel Top-Down Visual and Topic AttentionIEEE Transactions on Circuits and Systems for Video Technology, 2022
- Knowledge-Enriched Visual StorytellingProceedings of the AAAI Conference on Artificial Intelligence, 2020
- Multimodal Transformer With Multi-View Visual Representation for Image CaptioningIEEE Transactions on Circuits and Systems for Video Technology, 2019
- Movie DescriptionInternational Journal of Computer Vision, 2017
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- The Cambridge Introduction to Narrative2008
- Long Short-Term MemoryNeural Computation, 1997