RecipeGen: A Step-Aligned Multimodal Benchmark for Real-World Recipe Generation
Preprint
Abstract
Creating recipe images is a key challenge in food computing, with applications in culinary education and multimodal recipe assistants. However, existing datasets lack fine-grained alignment between recipe goals, step-wise instructions, and visual content. We present RecipeGen, the first large-scale, real-world benchmark for recipe-based Text-to-Image (T2I), Image-to-Video (I2V), and Text-to-Video (T2V) generation. RecipeGen contains 26,453 recipes, 196,724 images, and 4,491 videos, covering diverse ingredients, cooking procedures, styles, and dish types. We further propose domain-specific evaluation metrics to assess ingredient fidelity and interaction modeling, benchmark representative T2I, I2V, and T2V models, and provide insights for future recipe generation models. Project page is available now.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- FoodLMM: A Versatile Food Assistant Using Large Multi-Modal ModelIEEE Transactions on Multimedia, 2025
- FoodSky: A food-oriented large language model that can pass the chef and dietetic examinationsPatterns, 2025
- FoodSAM: Any Food SegmentationIEEE Transactions on Multimedia, 2023
- Deep learning in food category recognitionInformation Fusion, 2023
- Learning Structural Representations for Recipe Generation and Food RetrievalIEEE Transactions on Pattern Analysis and Machine Intelligence, 2022
- RecipeDB: a resource for exploring recipesDatabase: The Journal of Biological Databases and Curation, 2020
- Food Recommendation: Framework, Existing Solutions, and ChallengesIEEE Transactions on Multimedia, 2020
- Multi-Scale Multi-View Deep Feature Aggregation for Food RecognitionIEEE Transactions on Image Processing, 2019
- Recipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food ImagesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2019
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004