Abstract
In app-based data collection, researchers increasingly provide participants with personalized feedback based on participants’ data and study behavior. Personalizedfeedback is hypothesized to have positive effects on participant engagement and data quality. However, empirical evidence on these positive effects and research on the mechanisms on the effects that feedback has on participation remains scarce. We investigate what characteristics participants have who interact with their feedback and whether feedback affects data quality in an app-based household budget diary study in the general population of the Netherlands. The timing of providing personalized feedback was varied by random assignment to two experimental conditions: half of the participants received their personalized feedback instantly, and another half received their personalized feedback after 14 days, at the end of the study. We used mobile app paradata to study actual feedback-viewing behavior. We find that most but not all participants view their personalized feedback and older participants are more likely to visit their feedback more often and for longer periods. We find no difference in data quality between participants that received instant feedback or delayed feedback, but using paradata, we find a positive relationship between data quality and the duration of viewing the feedback by participants. This finding suggests that the collection of in-app paradata can provide more nuance about the effect of personalized feedback on data quality, and that paradata can inform researchers about whether the costly efforts of implementing personalized feedback are worth undertaking.