Video Repurposing from User Generated Content: A Large-scale Dataset and Benchmark
Authors:
Open Access
- 11 April 2025
- journal article
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI Conference on Artificial Intelligence
- Vol. 39 (8) , 8487-8495
Abstract
The demand for producing short-form videos for sharing on social media platforms has experienced significant growth in recent times. Despite notable advancements in the fields of video summarization and highlight detection, which can create partially usable short films from raw videos, these approaches are often domain-specific and require an in-depth understanding of real-world video content. To tackle this predicament, we propose Repurpose-10K, an extensive dataset comprising over 10,000 videos with more than 120,000 annotated clips aimed at resolving the video long-to-short task. Recognizing the inherent constraints posed by untrained human annotators, which can result in inaccurate annotations for repurposed videos, we propose a two-stage solution to obtain annotations from real-world user-generated content. Furthermore, we offer a baseline model to address this challenging task by integrating audio, visual, and caption aspects through a cross-modal fusion and alignment framework. We aspire for our work to ignite groundbreaking research in the lesser-explored realms of video repurposing.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Causal Prompting: Debiasing Large Language Model Prompting Based on Front-Door AdjustmentProceedings of the AAAI Conference on Artificial Intelligence, 2025
- LLMFormer: Large Language Model for Open-Vocabulary Semantic SegmentationInternational Journal of Computer Vision, 2024
- PodReels: Human-AI Co-Creation of Video Podcast Teasers2024
- Self-Supervised 3D Scene Flow Estimation and Motion Prediction Using Local Rigidity PriorIEEE Transactions on Pattern Analysis and Machine Intelligence, 2024
- Unified Open-Vocabulary Dense Visual PredictionIEEE Transactions on Multimedia, 2024
- Transformer-Empowered Invariant Grounding for Video Question AnsweringIEEE Transactions on Pattern Analysis and Machine Intelligence, 2023
- A Text-Guided Generation and Refinement Model for Image CaptioningIEEE Transactions on Multimedia, 2022
- ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning2021
- PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern RecognitionIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2020
- Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression2019