The degree of knowledge gain metric: Evaluating how searchers acquire new information while searching online
- 22 September 2026
- journal article
- research article
- Published by SAGE Publications in Journal of Information Science
Abstract
This study presents the degree of knowledge gain, a behavioral metric that estimates how much searchers learn during Web searches. Grounded in information theory and Shannon entropy, the metric quantifies reductions in uncertainty by analyzing query reformulations, clicks, and document positions, avoiding reliance on pre/post-testing or self-reports. The metric was validated with a cohort of legal professionals who completed three domain-specific search tasks on a national legal platform. Behavioral coding of think-aloud sessions and statistical tests (analysis of variance; Spearman rank correlation) demonstrated strong positive correlations between the degree of knowledge gain and conventional transfer of learning scores, with structured tasks producing the highest gains. This approach offers an automated, scalable indicator of learning, enriching the Searching as Learning paradigm and enabling real-time adaptation in personalized search, intelligent tutoring, and conversational systems.Keywords
Funding Information
- Conselho Nacional de Desenvolvimento Científico e Tecnológico (305436/2021-0)
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (Portaria CAPES n° 275/2023)
This publication has 74 references indexed in Scilit:
- Unraveling the Impact of Visual Complexity on Search as Learning2025
- On the Influence of Reading Sequences on Knowledge Gain During Web Search2024
- Predicting Knowledge Gain During Web Search Based on Multimedia Resource Consumption2021
- Topic-independent modeling of user knowledge in informational search sessionsInformation Retrieval Journal, 2021
- Investigation of users' knowledge change process in learning‐related search tasksProceedings of the Association for Information Science and Technology, 2019
- Concurrent think-aloud protocols to assess elementary design studentsInternational Journal of Technology and Design Education, 2014
- Probability as a Measure of Information AddedJournal of Logic, Language and Information, 2011
- Belief and Degrees of Belief2009
- Remarks on the measurement of subjective probability and informationMetrika, 1967
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948