A Deep Learning Model for the Assessment of the Visual Aesthetics of Mobile User Interfaces
Authors:
Open Access
- 8 March 2024
- journal article
- research article
- Published by Sociedade Brasileira de Computação in Journal of the Brazilian Computer Society
- Vol. 30 (1) , 102-115
Abstract
Visual aesthetics is one of the first aspects that users experience when looking at graphical user interfaces (GUIs), contributing to the perceived usability and credibility of a software system. It can also be an essential success factor in contexts where graphical elements play an important role in attracting users, such as choosing a mobile app from an app store. Therefore, visual aesthetics assessments are crucial in interface design, but traditional methods, involving target user representatives assessing each GUI individually, are costly and time-consuming. In this context, machine learning models have been demonstrated to be promising in automating the assessment of GUIs of web-based software systems. Yet, solutions for the assessment of mobile GUIs using machine learning are still unknown. Here we introduce a deep learning model to assess the visual aesthetics of mobile Android applications designed with App Inventor. We used a supervised learning approach to train and compare models using three different architectures. The highest performing model, a Resnet50, achieved a mean squared error of .022. The assessments of new GUIs showed an excellent correlation with human ratings (ρ = .9), and the Bland Altman plot analysis revealed 95% agreement with their labels. These results indicate the model’s effectiveness in automating the visual aesthetics assessment of GUIs of mobile apps.Keywords
This publication has 60 references indexed in Scilit:
- Benchmarking Neural Networks-Based Approaches for Predicting Visual Perception of User Interfaces2022
- Computational model for predicting user aesthetic preference for GUI using DCNNsCCF Transactions on Pervasive Computing and Interaction, 2021
- Neural Networks and Deep Learning2018
- Effects of interface design factors on affective responses and quality evaluations in mobile applicationsComputers in Human Behavior, 2017
- Linking objective design factors with subjective aesthetics: An experimental study on how structure and color of websites affect the facets of users’ visual aesthetic perceptionComputers in Human Behavior, 2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- An Exploratory Study on the Relation between User Interface Complexity and the Perceived Quality2014
- Is beautiful really usable? Toward understanding the relation between usability, aesthetics, and affect in HCIComputers in Human Behavior, 2012
- Designing emotionally evocative homepages: an empirical study of the quantitative relations between design factors and emotional dimensionsInternational Journal of Human-Computer Studies, 2003
- Sample Size Requirements for Estimating Pearson, Kendall and Spearman CorrelationsPsychometrika, 2000