Image2Emoji
Authors:
Open Access
- 13 October 2015
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1311-1314
Abstract
We present Image2Emoji, a multi-modal approach for generating emoji labels for an image in a zero-shot manner. Different from existing zero-shot image-to-text approaches, we exploit both image and textual media to learn a semantic embedding for the new task of emoji prediction. We propose that the widespread adoption of emoji suggests a semantic universality which is well-suited for interaction with visual media. We quantify the efficacy of our proposed model on the MSCOCO dataset, and demonstrate the value of visual, textual and multi-modal prediction of emoji. We conclude the paper with three examples of the application potential of emoji in the context of multimedia retrieval.Keywords
Funding Information
- Technologiestichting STW
This publication has 4 references indexed in Scilit: