Informfully - Research Platform for Reproducible User Studies
Open Access
- 8 October 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 660-669
Abstract
This paper presents Informfully, a research platform for content distribution and user studies. Informfully allows to push algorithmically curated text, image, audio, and video content to users and automatically generates a detailed log of their consumption history. As such, it serves as an open-source platform for conducting user experiments to investigate the impact of item recommendations on users’ consumption behavior. The platform was designed to accommodate different experiment types through versatility, ease of use, and scalability. It features three core components: 1) a front end for displaying and interacting with recommended items, 2) a back end for researchers to create and maintain user experiments, and 3) a simple JSON-based exchange format for ranked item recommendations to interface with third-party frameworks. We provide a system overview and outline the three core components of the platform. A sample workflow is shown for conducting field studies incorporating multiple user groups, personalizing recommendations, and measuring the effect of algorithms on user engagement. We present evidence for the versatility, ease of use, and scalability of Informfully by showcasing previous studies that used our platform.Keywords
Funding Information
- Hasler Stiftung
This publication has 23 references indexed in Scilit:
- Benefits of Diverse News Recommendations for Democracy: A User StudyDigital Journalism, 2022
- A hybrid recommender system for recommending relevant movies using an expert systemExpert Systems with Applications, 2020
- Designing for the better by taking users into account2019
- On the Democratic Role of News RecommendersDigital Journalism, 2019
- A Comparison of Offline Evaluations, Online Evaluations, and User Studies in the Context of Research-Paper Recommender Systems2015
- Research-paper recommender systems: a literature surveyInternational Journal on Digital Libraries, 2015
- PEN recsys2013
- Recommender Systems in Computer Science and Information Systems – A Landscape of Research2012
- User Interface Design Guidelines Arrangement in a Recommender System with Frame OntologyLecture Notes in Computer Science, 2012
- MoviExplain2009