Evaluation in Neural Style Transfer: A Review
Open Access
- 30 July 2024
- journal article
- research article
- Published by Wiley in Computer Graphics Forum
- Vol. 43 (6)
Abstract
The field of neural style transfer (NST) has witnessed remarkable progress in the past few years, with approaches being able to synthesize artistic and photorealistic images and videos of exceptional quality. To evaluate such results, a diverse landscape of evaluation methods and metrics is used, including authors' opinions based on side‐by‐side comparisons, human evaluation studies that quantify the subjective judgements of participants, and a multitude of quantitative computational metrics which objectively assess the different aspects of an algorithm's performance. However, there is no consensus regarding the most suitable and effective evaluation procedure that can guarantee the reliability of the results. In this review, we provide an in‐depth analysis of existing evaluation techniques, identify the inconsistencies and limitations of current evaluation methods, and give recommendations for standardized evaluation practices. We believe that the development of a robust evaluation framework will not only enable more meaningful and fairer comparisons among NST methods but will also enhance the comprehension and interpretation of research findings in the field.Keywords
All Related Versions
Funding Information
- Engineering and Physical Sciences Research Council (EP/R513313/1)
This publication has 95 references indexed in Scilit:
- CCPL: Contrastive Coherence Preserving Loss for Versatile Style Transfer2022
- ArtFID: Quantitative Evaluation of Neural Style Transfer2022
- ReCoNet: Real-Time Coherent Video Style Transfer Network2019
- Multi-style Generative Network for Real-Time Transfer2019
- A Closed-Form Solution to Photorealistic Image Stylization2018
- A Style-Aware Content Loss for Real-Time HD Style Transfer2018
- Perceptual Losses for Real-Time Style Transfer and Super-Resolution2016
- Artistic Style Transfer for Videos2016
- Microsoft COCO: Common Objects in Context2014
- Individual Comparisons by Ranking Methods1992