Click2Insert: Video Object Insertion via Sparse Click Guidance
Open Access
- 9 November 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 16085-16094
Abstract
With the rapid progress of video editing technologies, video object insertion has attracted increasing attention. Existing approaches typically rely on either text instructions, which often lack precise spatial control, or dense masks, which are costly and impractical to annotate manually. To address these limitations, we present Click2Insert, a video object insertion framework that enables precise insertion using only a few point annotations on keyframes. Our framework is also compatible with mask inputs, enabling flexible control and supporting mask-based editing across different scenarios. To train the model, we further construct a large-scale paired insertion dataset containing 1.2M samples through an automated pipeline. Furthermore, we improve sparse-guided video object insertion from three perspectives: condition compatibility, spatial accuracy, and temporal coherence. Specifically, we introduce Task Aware Modulation to support both point- and mask-based conditions within a single model, Spatial-Aware Loss to improve positional accuracy under sparse point supervision, and Intra-Chunk Temporal Attention to enhance temporal consistency across adjacent frames. Extensive experiments demonstrate that our method achieves superior editing performance, enabling precise object insertion in a more user-friendly and flexible manner.Keywords
This publication has 10 references indexed in Scilit:
- OmniInsert: Mask-Free Video Insertion of Any Reference via Diffusion Transformer Models2026
- Flowedit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Models2025
- VideoAnydoor: High-fidelity Video Object Insertion with Precise Motion Control2025
- VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Control2025
- Decoupled Distillation to Erase: A General Unlearning Method for Any Class-centric Tasks2025
- Diffusion Model-Based Image Editing: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2025
- Non-imaging Medical Data Synthesis for Trustworthy AI: A Comprehensive SurveyACM Computing Surveys, 2024
- ReVideo: Remake a Video with Motion and Content Control2024
- Diffusion Models in Vision: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2023
- Towards An End-to-End Framework for Flow-Guided Video Inpainting2022