A Framework for Externalizing Implicit Error Using Visualization
- 28 August 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 25 (1) , 925-935
Abstract
This paper presents a framework for externalizing and analyzing expert knowledge about discrepancies in data through the use of visualization. Grounded in an 18-month design study with global health experts, the framework formalizes the notion of data discrepancies as implicit error, both in global health data and more broadly. We use the term implicit error to describe measurement error that is inherent to and pervasive throughout a dataset, but that isn't explicitly accounted for or defined. Instead, implicit error exists in the minds of experts, is mainly qualitative, and is accounted for subjectively during expert interpretation of the data. Externalizing knowledge surrounding implicit error can assist in synchronizing, validating, and enhancing interpretation, and can inform error analysis and mitigation. The framework consists of a description of implicit error components that are important for downstream analysis, along with a process model for externalizing and analyzing implicit error using visualization. As a second contribution, we provide a rich, reflective, and verifiable description of our research process as an exemplar summary toward the ongoing inquiry into ways of increasing the validity and transferability of design study research.Keywords
Funding Information
- NSF (GRF-1747505)
This publication has 56 references indexed in Scilit:
- Grey Literature: Its Emerging ImportanceJournal of Hospital Librarianship, 2011
- The GLEaMviz computational tool, a publicly available software to explore realistic epidemic spreading scenarios at the global scaleBMC Infectious Diseases, 2011
- Participatory Epidemiology: Use of Mobile Phones for Community-Based Health ReportingPLOS Medicine, 2010
- Understanding Interactive Legends: a Comparative Evaluation with Standard WidgetsComputer Graphics Forum, 2010
- HealthMap: Global Infectious Disease Monitoring through Automated Classification and Visualization of Internet Media ReportsJournal of the American Medical Informatics Association, 2008
- Forgotten millions: a case of cultural and systemic biasSupport for Learning, 2007
- AEGIS: A Robust and Scalable Real-time Public Health Surveillance SystemJournal of the American Medical Informatics Association, 2007
- The wisdom hierarchy: representations of the DIKW hierarchyJournal of Information Science, 2007
- Critically reflective practiceJournal of Continuing Education in the Health Professions, 1998
- Visualization of an imperfect worldIEEE Computer Graphics and Applications, 1998