How real is real enough? Participant feedback on a behavioral simulation used for information-seeking behavior research
- 12 January 2022
- journal article
- research article
- Published by SAGE Publications in Journal of Librarianship and Information Science
- Vol. 55 (1) , 191-207
Abstract
A challenge of studying information-seeking behavior in open web systems is the unpredictability of those systems. One solution to counteract this issue is employing a simulation to ensure experimental control. However, concerns arise over the realism of such an environment. This paper assesses the realism of a behavioral simulation used to study the evaluation behavior of 175 students from fourth grade through graduate school. We assess realism through the examination of targeted participant feedback about what would have made the simulated environment and tasks more realistic to these participants. Based on this feedback, we reflect on decisions made in designing the simulation and offer recommendations for future studies interested in incorporating behavioral simulation in their research design. We find that a thoughtfully designed simulation can elicit naturalistic behavior when the controlled environment is designed to be realistic in meaningful ways. Because the simulation does not have to perfectly match reality to elicit these behaviors, designing a simulation that is real enough is an effective method to study information-seeking behavior.Keywords
Funding Information
- Institute of Museum and Library Services (LG-81-15-0155)
This publication has 28 references indexed in Scilit:
- An Introduction to Simulation for Learning2013
- A systematic review of interactive information retrieval evaluation studies, 1967–2006Journal of the American Society for Information Science and Technology, 2013
- Information literacy assessmentJournal of Librarianship and Information Science, 2009
- WiIRE: the Web interactive information retrieval experimentation system prototypeInformation Processing & Management, 2004
- Evaluation of an Information System in an Information Seeking ProcessLecture Notes in Computer Science, 2004
- Experimental components for the evaluation of interactive information retrieval systemsJournal of Documentation, 2000
- Behavioral Simulation: Application and Potential in Management ResearchOrganizational Research Methods, 1998
- Microworlds for experimental research: Having your (control and collection) cake, and realism tooBehavior Research Methods, Instruments, & Computers, 1998
- The development of a method for the evaluation of interactive information retrieval systemsJournal of Documentation, 1997
- The cognitive viewpoint in information scienceJournal of Information Science, 1990