Text-Guided Image Editing Based on Post Score for Gaining Attention on Social Media
Open Access
Abstract
Text-guided image editing has been highlighted in the fields of computer vision and natural language processing in recent years. The approach takes an image and text prompt as input and aims to edit the image in accordance with the text prompt while preserving text-unrelated regions. The results of text-guided image editing differ depending on the way the text prompt is represented, even if it has the same meaning. It is up to the user to decide which result best matches the intended use of the edited image. This paper assumes a situation in which edited images are posted to social media and proposes a novel text-guided image editing method to help the edited images gain attention from a greater audience. In the proposed method, we apply the pre-trained text-guided image editing method and obtain multiple edited images from the multiple text prompts generated from a large language model. The proposed method leverages the novel model that predicts post scores representing engagement rates and selects one image that will gain the most attention from the audience on social media among these edited images. Subject experiments on a dataset of real Instagram posts demonstrate that the edited images of the proposed method accurately reflect the content of the text prompts and provide a positive impression to the audience on social media compared to those of previous text-guided image editing methods.Keywords
Funding Information
- Japan Society for the Promotion of Science (JP21H03456, JP23K11141, JP23K11211)
This publication has 36 references indexed in Scilit:
- A survey of image synthesis and editing with generative adversarial networksTsinghua Science and Technology, 2017
- From incidental news exposure to news engagement. How perceptions of the news post and news usage patterns influence engagement with news articles encountered on FacebookComputers in Human Behavior, 2017
- Elements of strategic social media marketing: A holistic frameworkJournal of Business Research, 2017
- Let there be color!ACM Transactions on Graphics, 2016
- Identifying effective influencers based on trust for electronic word-of-mouth marketing: A domain-aware approachInformation Sciences, 2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Microsoft COCO: Common Objects in Context2014
- AVA: A large-scale database for aesthetic visual analysis2012
- Image inpainting2000
- Long Short-Term MemoryNeural Computation, 1997