David Gotz
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
David Gotz has a total of 89 co-authors. Here are the top co-authors by number of shared publications:
- David Borland
RENCI and The University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
18 shared publications - Arran Zeyu Wang
University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
8 shared publications - Wenyuan Wang
University of North Carolina Chapel Hill, Chapel Hill, NC 27599, USA
7 shared publications - Jonathan Zhang
Dept. of Biostatistics at the University of North Carolina at Chapel Hill
6 shared publications - Nan Cao
College of Design and Innovation, Tongji University, Shanghai, China
6 shared publications - Joshua Shrestha
Dept. of Computer Science at the University of North Carolina at Chapel Hill
4 shared publications
Latest Publications
- Open Access
- 26 August 2026
- Published by JMIR Publications Inc. in JMIR Preprints
Design as an Ingredient: Applying Human–Centered Design to Improve the Utility of Infectious Disease Scenario Projections for State, Tribal, Local, and Territorial Agencies (Preprint)
BACKGROUND Infectious disease modeling tools are essential for public health decision-making, but their utility is limited when visualizations do not reflect end-user needs. The U.S.-based Scenario Modeling Hub (SMH) provides scenario projections for public health practitioners, yet previous designs were not informed by human-centered design principles. Applying these methods may improve clarity, interpretability, and real-world usefulness of model outputs for decision-makers. OBJECTIVE The goal of this study was to increase the relevance and utility of infectious disease models and scenario projections for public health officials nationwide by embedding human-centered design methods as an “ingredient” in the re-design of a modeling dashboard with visualizations. METHODS From January through July 2025, the Design and Innovation for the Public Good (DIPG) unit at The University of North Caroline at Chapel Hill, in partnership with the Atlantic Coast Center for Infectious Disease Dynamics and Analytics (ACCIDDA) and the Council of State and Territorial Epidemiologists (CSTE), facilitated three rounds of virtual focus groups with public health officials nationwide. Round 1 explored use cases for scenario projections; Round 2 gathered feedback on existing SMH visualizations and sketches; and Round 3 tested low-fidelity prototypes of the redesigned website. A structured assumption-testing framework guided prototype development, and data were synthesized using human–centered design (HCD) analysis tools. RESULTS Round 1 participants (n=19) identified seven priority information needs and emphasized needs for transparency around data sources and methods and actionable, locally tailored projections. In Round 2, participants (n=16) preferred simple, context-rich visuals such as epidemic curves, case counts, the ability to compare potential interventions, and curated insights. In Round 3, participants (n=9) supported comparing multiple scenarios, embedding takeaways within dashboards, and replacing mandatory onboarding with optional learning resources. CONCLUSIONS Embedding HCD as an “ingredient” can improve usability and acceptability of analytic tools for epidemiologists and public health officials nationwide so that these tools will be used more and be more helpful.
- 26 August 2026
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessDesign as an Ingredient: Applying Human–Centered Design to Improve the Utility of Infectious Disease Scenario Projections for State, Tribal, Local, and Territorial Agencies (Preprint)
BACKGROUND Infectious disease modeling tools are essential for public health decision-making, but their utility is limited when visualizations do not reflect end-user needs. The U.S.-based Scenario Modeling Hub (SMH) provides scenario projections for public health practitioners, yet previous designs were not informed by human-centered design principles. Applying these methods may improve clarity, interpretability, and real-world usefulness of model outputs for decision-makers. OBJECTIVE The goal of this study was to increase the relevance and utility of infectious disease models and scenario projections for public health officials nationwide by embedding human-centered design methods as an “ingredient” in the re-design of a modeling dashboard with visualizations. METHODS From January through July 2025, the Design and Innovation for the Public Good (DIPG) unit at The University of North Caroline at Chapel Hill, in partnership with the Atlantic Coast Center for Infectious Disease Dynamics and Analytics (ACCIDDA) and the Council of State and Territorial Epidemiologists (CSTE), facilitated three rounds of virtual focus groups with public health officials nationwide. Round 1 explored use cases for scenario projections; Round 2 gathered feedback on existing SMH visualizations and sketches; and Round 3 tested low-fidelity prototypes of the redesigned website. A structured assumption-testing framework guided prototype development, and data were synthesized using human–centered design (HCD) analysis tools. RESULTS Round 1 participants (n=19) identified seven priority information needs and emphasized needs for transparency around data sources and methods and actionable, locally tailored projections. In Round 2, participants (n=16) preferred simple, context-rich visuals such as epidemic curves, case counts, the ability to compare potential interventions, and curated insights. In Round 3, participants (n=9) supported comparing multiple scenarios, embedding takeaways within dashboards, and replacing mandatory onboarding with optional learning resources. CONCLUSIONS Embedding HCD as an “ingredient” can improve usability and acceptability of analytic tools for epidemiologists and public health officials nationwide so that these tools will be used more and be more helpful.
- 1 July 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (7) , 5113-5127
Contextualization or Rationalization? The Effect of Causal Priors on Data Visualization Interpretation
Understanding how individuals interpret charts is a crucial concern for visual data communication. This imperative has motivated a number of studies, including past work demonstrating that causal priors-a priori belief about causal relationships between concepts-can have significant influences on the perceived strength of variable relationships inferred from visualizations. This paper builds on these previous results, demonstrating that causal priors can also influence the types of patterns that people perceive as the most salient within ambiguous scatterplots that have roughly equal evidence for trend and cluster patterns. Using a mixed-design approach that combines a large-scale online experiment for breadth of findings with an in-person think-aloud study for analytical depth, we investigated how users' interpretations are influenced by the interplay between causal priors and the visualized data patterns. Our analysis suggests two archetypal reasoning behaviors through which people often make their observations: contextualization, in which users accept a visual pattern that aligns with causal priors and use their existing knowledge to enrich interpretation, and rationalization, in which users encounter a pattern that conflicts with causal priors and attempt to explain away the discrepancy by invoking external factors, such as positing confounding variables or data selection bias. These findings provide initial evidence highlighting the critical role of causal priors in shaping high-level visualization comprehension, and introduce a vocabulary for describing how users reason about data that either confirms or challenges prior beliefs of causality.
- 1 July 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (7) , 5113-5127
Contextualization or Rationalization? The Effect of Causal Priors on Data Visualization Interpretation
Understanding how individuals interpret charts is a crucial concern for visual data communication. This imperative has motivated a number of studies, including past work demonstrating that causal priors-a priori belief about causal relationships between concepts-can have significant influences on the perceived strength of variable relationships inferred from visualizations. This paper builds on these previous results, demonstrating that causal priors can also influence the types of patterns that people perceive as the most salient within ambiguous scatterplots that have roughly equal evidence for trend and cluster patterns. Using a mixed-design approach that combines a large-scale online experiment for breadth of findings with an in-person think-aloud study for analytical depth, we investigated how users' interpretations are influenced by the interplay between causal priors and the visualized data patterns. Our analysis suggests two archetypal reasoning behaviors through which people often make their observations: contextualization, in which users accept a visual pattern that aligns with causal priors and use their existing knowledge to enrich interpretation, and rationalization, in which users encounter a pattern that conflicts with causal priors and attempt to explain away the discrepancy by invoking external factors, such as positing confounding variables or data selection bias. These findings provide initial evidence highlighting the critical role of causal priors in shaping high-level visualization comprehension, and introduce a vocabulary for describing how users reason about data that either confirms or challenges prior beliefs of causality.
- Open Access
- 25 June 2026
- Published by Association for Computing Machinery (ACM)
- p. 2359-2384
Risks and Opportunities in Human-Machine Teaming in Operationalizing Machine Learning Target Variables
Predictive modeling has the potential to enhance human decision-making. However, many predictive models fail in practice due to problematic problem formulation in cases where the prediction target is an abstract concept or construct, and practitioners need to define an appropriate target variable as a proxy to operationalize the construct of interest. Selecting an appropriate proxy target variable is a challenging process in practice, requiring both domain knowledge and iterative data modeling. While emerging prototyping tools promise to accelerate this process, it remains unclear how rapid iterations influence human judgment in problem formulation. In this work, we conducted a controlled user study (N = 48) to investigate the impact of human-machine teaming on proxy target selection. We instantiate a system offering three recommendation strategies: Relevance-First (prioritizing conceptual alignment), Performance-First (prioritizing model performance), and Pareto-Front (considering both). We find that while rapid iterations can significantly improve exploration efficiency, they also tend to amplify a “performance bias”: the tendency to favor well-performing proxy targets even when they are not aligned with the modeling goal. However, systems that explicitly estimate and communicate the relevance of proxy targets can mitigate this bias. Our study highlights the risks and opportunities of human-machine teaming in operationalizing machine learning target variables, yielding insights for future research to explore the opportunities and mitigate the risks.
- 25 June 2026
- Published by Association for Computing Machinery (ACM)
- p. 2359-2384
Open AccessRisks and Opportunities in Human-Machine Teaming in Operationalizing Machine Learning Target Variables
Predictive modeling has the potential to enhance human decision-making. However, many predictive models fail in practice due to problematic problem formulation in cases where the prediction target is an abstract concept or construct, and practitioners need to define an appropriate target variable as a proxy to operationalize the construct of interest. Selecting an appropriate proxy target variable is a challenging process in practice, requiring both domain knowledge and iterative data modeling. While emerging prototyping tools promise to accelerate this process, it remains unclear how rapid iterations influence human judgment in problem formulation. In this work, we conducted a controlled user study (N = 48) to investigate the impact of human-machine teaming on proxy target selection. We instantiate a system offering three recommendation strategies: Relevance-First (prioritizing conceptual alignment), Performance-First (prioritizing model performance), and Pareto-Front (considering both). We find that while rapid iterations can significantly improve exploration efficiency, they also tend to amplify a “performance bias”: the tendency to favor well-performing proxy targets even when they are not aligned with the modeling goal. However, systems that explicitly estimate and communicate the relevance of proxy targets can mitigate this bias. Our study highlights the risks and opportunities of human-machine teaming in operationalizing machine learning target variables, yielding insights for future research to explore the opportunities and mitigate the risks.
- Open Access
Visual Analytics for Causal Reasoning from Real-World Health Data
The increasing capture and analysis of large-scale longitudinal health data offer opportunities to improve healthcare and advance medical understanding. However, a critical gap exists between (a) -- the observation of patterns and correlations, versus (b) -- the understanding of true causal mechanisms that drive outcomes. An accurate understanding of the underlying mechanisms that cause various changes in medical status is crucial for decision-makers across various healthcare domains and roles, yet inferring causality from real-world observational data is difficult for both methodological and practical challenges. This Grand Challenge advocates increased Visual Analytics (VA) research on this topic to empower people with the tool for sound causal reasoning from health data. We note this is complicated by the complex nature of medical data -- the volume, variety, sparsity, and temporality of health data streams make the use of causal inference algorithms difficult. Combined with challenges imposed by the realities of health-focused settings, including time constraints and traditional medical work practices, existing causal reasoning approaches are valuable but insufficient. We argue that advances in research can lead to new VA tools that augment human expertise with intuitive and robust causal inference capabilities, which can help realize a new paradigm of data-driven, causality-aware healthcare practices that improve human health outcomes.
Open AccessVisual Analytics for Causal Reasoning from Real-World Health Data
The increasing capture and analysis of large-scale longitudinal health data offer opportunities to improve healthcare and advance medical understanding. However, a critical gap exists between (a) -- the observation of patterns and correlations, versus (b) -- the understanding of true causal mechanisms that drive outcomes. An accurate understanding of the underlying mechanisms that cause various changes in medical status is crucial for decision-makers across various healthcare domains and roles, yet inferring causality from real-world observational data is difficult for both methodological and practical challenges. This Grand Challenge advocates increased Visual Analytics (VA) research on this topic to empower people with the tool for sound causal reasoning from health data. We note this is complicated by the complex nature of medical data -- the volume, variety, sparsity, and temporality of health data streams make the use of causal inference algorithms difficult. Combined with challenges imposed by the realities of health-focused settings, including time constraints and traditional medical work practices, existing causal reasoning approaches are valuable but insufficient. We argue that advances in research can lead to new VA tools that augment human expertise with intuitive and robust causal inference capabilities, which can help realize a new paradigm of data-driven, causality-aware healthcare practices that improve human health outcomes.
- 21 October 2024
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 31 (11) , 2423-2428
Reflections on interactive visualization of electronic health records: past, present, future
In the early 2000s, the transition to paperless documentation of patients’ health data begun at large scale, with the introduction of Electronic Health and Medical Records (EHR and EMR, respectively). This constituted a paradigm shift in how patient data was stored and exchanged among institutions. The impact of the so-called “Electronic Health Revolution” 1 was significant. Standardization of personal health data allowed for a more uniform definition of diagnoses and their ensuing clinical process, with fewer mistakes in diagnosis and treatment, and a more reliable application of medical guidelines. 2 For instance, in the United States (US), patients now have control over their information, with more mandated electronic access. 3 Recent studies showed that online medical records by US adults doubled over the last 8 years. 4 Simultaneously, a new generation of smart, affordable, and wearable devices, such as smartwatches, has emerged. These devices generate fine-grained and continuous data about the health status of their users, with minimal discomfort, eliminating the need for specialized equipment. The rapid evolution of Artificial Intelligence (AI) technologies is about to significantly impact healthcare as well. AI technologies present opportunities and challenges for both physicians and patients. 5 AI models recognize patterns in complex datasets, potentially identifying a broader range of disease progression patterns that might not be immediately apparent to clinicians or patients. However, the inherent “black-box” nature of AI has slowed its adoption, as healthcare professionals often struggle to evaluate the underlying process that led to the AI recommendations. In essence, while it can be impressive what AI models predict, concerns remain about why the AI produces a particular output, and how. The considerable lack of transparency impedes trust-building, such that “the doctor just won’t accept that,” 6 calling for explainable AI output.
- 21 October 2024
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 31 (11) , 2423-2428
Reflections on interactive visualization of electronic health records: past, present, future
In the early 2000s, the transition to paperless documentation of patients’ health data begun at large scale, with the introduction of Electronic Health and Medical Records (EHR and EMR, respectively). This constituted a paradigm shift in how patient data was stored and exchanged among institutions. The impact of the so-called “Electronic Health Revolution” 1 was significant. Standardization of personal health data allowed for a more uniform definition of diagnoses and their ensuing clinical process, with fewer mistakes in diagnosis and treatment, and a more reliable application of medical guidelines. 2 For instance, in the United States (US), patients now have control over their information, with more mandated electronic access. 3 Recent studies showed that online medical records by US adults doubled over the last 8 years. 4 Simultaneously, a new generation of smart, affordable, and wearable devices, such as smartwatches, has emerged. These devices generate fine-grained and continuous data about the health status of their users, with minimal discomfort, eliminating the need for specialized equipment. The rapid evolution of Artificial Intelligence (AI) technologies is about to significantly impact healthcare as well. AI technologies present opportunities and challenges for both physicians and patients. 5 AI models recognize patterns in complex datasets, potentially identifying a broader range of disease progression patterns that might not be immediately apparent to clinicians or patients. However, the inherent “black-box” nature of AI has slowed its adoption, as healthcare professionals often struggle to evaluate the underlying process that led to the AI recommendations. In essence, while it can be impressive what AI models predict, concerns remain about why the AI produces a particular output, and how. The considerable lack of transparency impedes trust-building, such that “the doctor just won’t accept that,” 6 calling for explainable AI output.
- 10 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 31 (1) , 776-786
Beyond Correlation: Incorporating Counterfactual Guidance to Better Support Exploratory Visual Analysis
Providing effective guidance for users has long been an important and challenging task for efficient exploratory visual analytics, especially when selecting variables for visualization in high-dimensional datasets. Correlation is the most widely applied metric for guidance in statistical and analytical tools, however a reliance on correlation may lead users towards false positives when interpreting causal relations in the data. In this work, inspired by prior insights on the benefits of counterfactual visualization in supporting visual causal inference, we propose a novel, simple, and efficient counterfactual guidance method to enhance causal inference performance in guided exploratory analytics based on insights and concerns gathered from expert interviews. Our technique aims to capitalize on the benefits of counterfactual approaches while reducing their complexity for users. We integrated counterfactual guidance into an exploratory visual analytics system, and using a synthetically generated ground-truth causal dataset, conducted a comparative user study and evaluated to what extent counterfactual guidance can help lead users to more precise visual causal inferences. The results suggest that counterfactual guidance improved visual causal inference performance, and also led to different exploratory behaviors compared to correlation-based guidance. Based on these findings, we offer future directions and challenges for incorporating counterfactual guidance to better support exploratory visual analytics.
- 10 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 31 (1) , 776-786
Beyond Correlation: Incorporating Counterfactual Guidance to Better Support Exploratory Visual Analysis
Providing effective guidance for users has long been an important and challenging task for efficient exploratory visual analytics, especially when selecting variables for visualization in high-dimensional datasets. Correlation is the most widely applied metric for guidance in statistical and analytical tools, however a reliance on correlation may lead users towards false positives when interpreting causal relations in the data. In this work, inspired by prior insights on the benefits of counterfactual visualization in supporting visual causal inference, we propose a novel, simple, and efficient counterfactual guidance method to enhance causal inference performance in guided exploratory analytics based on insights and concerns gathered from expert interviews. Our technique aims to capitalize on the benefits of counterfactual approaches while reducing their complexity for users. We integrated counterfactual guidance into an exploratory visual analytics system, and using a synthetically generated ground-truth causal dataset, conducted a comparative user study and evaluated to what extent counterfactual guidance can help lead users to more precise visual causal inferences. The results suggest that counterfactual guidance improved visual causal inference performance, and also led to different exploratory behaviors compared to correlation-based guidance. Based on these findings, we offer future directions and challenges for incorporating counterfactual guidance to better support exploratory visual analytics.
- 10 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 31 (1) , 765-775
Causal Priors and Their Influence on Judgements of Causality in Visualized Data
“Correlation does not imply causation” is a famous mantra in statistical and visual analysis. However, consumers of visualizations often draw causal conclusions when only correlations between variables are shown. In this paper, we investigate factors that contribute to causal relationships users perceive in visualizations. We collected a corpus of concept pairs from variables in widely used datasets and created visualizations that depict varying correlative associations using three typical statistical chart types. We conducted two MTurk studies on (1) preconceived notions on causal relations without charts, and (2) perceived causal relations with charts, for each concept pair. Our results indicate that people make assumptions about causal relationships between pairs of concepts even without seeing any visualized data. Moreover, our results suggest that these assumptions constitute causal priors that, in combination with visualized association, impact how data visualizations are interpreted. The results also suggest that causal priors may lead to over- or under-estimation in perceived causal relations in different circumstances, and that those priors can also impact users' confidence in their causal assessments. In addition, our results align with prior work, indicating that chart type may also affect causal inference. Using data from the studies, we develop a model to capture the interaction between causal priors and visualized associations as they combine to impact a user's perceived causal relations. In addition to reporting the study results and analyses, we provide an open dataset of causal priors for 56 specific concept pairs that can serve as a potential benchmark for future studies. We also suggest remaining challenges and heuristic-based guidelines to help designers improve visualization design choices to better support visual causal inference.
- 10 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 31 (1) , 765-775
Causal Priors and Their Influence on Judgements of Causality in Visualized Data
“Correlation does not imply causation” is a famous mantra in statistical and visual analysis. However, consumers of visualizations often draw causal conclusions when only correlations between variables are shown. In this paper, we investigate factors that contribute to causal relationships users perceive in visualizations. We collected a corpus of concept pairs from variables in widely used datasets and created visualizations that depict varying correlative associations using three typical statistical chart types. We conducted two MTurk studies on (1) preconceived notions on causal relations without charts, and (2) perceived causal relations with charts, for each concept pair. Our results indicate that people make assumptions about causal relationships between pairs of concepts even without seeing any visualized data. Moreover, our results suggest that these assumptions constitute causal priors that, in combination with visualized association, impact how data visualizations are interpreted. The results also suggest that causal priors may lead to over- or under-estimation in perceived causal relations in different circumstances, and that those priors can also impact users' confidence in their causal assessments. In addition, our results align with prior work, indicating that chart type may also affect causal inference. Using data from the studies, we develop a model to capture the interaction between causal priors and visualized associations as they combine to impact a user's perceived causal relations. In addition to reporting the study results and analyses, we provide an open dataset of causal priors for 56 specific concept pairs that can serve as a potential benchmark for future studies. We also suggest remaining challenges and heuristic-based guidelines to help designers improve visualization design choices to better support visual causal inference.
- Open Access
Beyond Correlation: Incorporating Counterfactual Guidance to Better Support Exploratory Visual Analysis
Providing effective guidance for users has long been an important and challenging task for efficient exploratory visual analytics, especially when selecting variables for visualization in high-dimensional datasets. Correlation is the most widely applied metric for guidance in statistical and analytical tools, however a reliance on correlation may lead users towards false positives when interpreting causal relations in the data. In this work, inspired by prior insights on the benefits of counterfactual visualization in supporting visual causal inference, we propose a novel, simple, and efficient counterfactual guidance method to enhance causal inference performance in guided exploratory analytics based on insights and concerns gathered from expert interviews. Our technique aims to capitalize on the benefits of counterfactual approaches while reducing their complexity for users. We integrated counterfactual guidance into an exploratory visual analytics system, and using a synthetically generated ground-truth causal dataset, conducted a comparative user study and evaluated to what extent counterfactual guidance can help lead users to more precise visual causal inferences. The results suggest that counterfactual guidance improved visual causal inference performance, and also led to different exploratory behaviors compared to correlation-based guidance. Based on these findings, we offer future directions and challenges for incorporating counterfactual guidance to better support exploratory visual analytics.
Open AccessBeyond Correlation: Incorporating Counterfactual Guidance to Better Support Exploratory Visual Analysis
Providing effective guidance for users has long been an important and challenging task for efficient exploratory visual analytics, especially when selecting variables for visualization in high-dimensional datasets. Correlation is the most widely applied metric for guidance in statistical and analytical tools, however a reliance on correlation may lead users towards false positives when interpreting causal relations in the data. In this work, inspired by prior insights on the benefits of counterfactual visualization in supporting visual causal inference, we propose a novel, simple, and efficient counterfactual guidance method to enhance causal inference performance in guided exploratory analytics based on insights and concerns gathered from expert interviews. Our technique aims to capitalize on the benefits of counterfactual approaches while reducing their complexity for users. We integrated counterfactual guidance into an exploratory visual analytics system, and using a synthetically generated ground-truth causal dataset, conducted a comparative user study and evaluated to what extent counterfactual guidance can help lead users to more precise visual causal inferences. The results suggest that counterfactual guidance improved visual causal inference performance, and also led to different exploratory behaviors compared to correlation-based guidance. Based on these findings, we offer future directions and challenges for incorporating counterfactual guidance to better support exploratory visual analytics.
- Open Access
Causal Priors and Their Influence on Judgements of Causality in Visualized Data
"Correlation does not imply causation" is a famous mantra in statistical and visual analysis. However, consumers of visualizations often draw causal conclusions when only correlations between variables are shown. In this paper, we investigate factors that contribute to causal relationships users perceive in visualizations. We collected a corpus of concept pairs from variables in widely used datasets and created visualizations that depict varying correlative associations using three typical statistical chart types. We conducted two MTurk studies on (1) preconceived notions on causal relations without charts, and (2) perceived causal relations with charts, for each concept pair. Our results indicate that people make assumptions about causal relationships between pairs of concepts even without seeing any visualized data. Moreover, our results suggest that these assumptions constitute causal priors that, in combination with visualized association, impact how data visualizations are interpreted. The results also suggest that causal priors may lead to over- or under-estimation in perceived causal relations in different circumstances, and that those priors can also impact users' confidence in their causal assessments. In addition, our results align with prior work, indicating that chart type may also affect causal inference. Using data from the studies, we develop a model to capture the interaction between causal priors and visualized associations as they combine to impact a user's perceived causal relations. In addition to reporting the study results and analyses, we provide an open dataset of causal priors for 56 specific concept pairs that can serve as a potential benchmark for future studies. We also suggest remaining challenges and heuristic-based guidelines to help designers improve visualization design choices to better support visual causal inference.
Open AccessCausal Priors and Their Influence on Judgements of Causality in Visualized Data
"Correlation does not imply causation" is a famous mantra in statistical and visual analysis. However, consumers of visualizations often draw causal conclusions when only correlations between variables are shown. In this paper, we investigate factors that contribute to causal relationships users perceive in visualizations. We collected a corpus of concept pairs from variables in widely used datasets and created visualizations that depict varying correlative associations using three typical statistical chart types. We conducted two MTurk studies on (1) preconceived notions on causal relations without charts, and (2) perceived causal relations with charts, for each concept pair. Our results indicate that people make assumptions about causal relationships between pairs of concepts even without seeing any visualized data. Moreover, our results suggest that these assumptions constitute causal priors that, in combination with visualized association, impact how data visualizations are interpreted. The results also suggest that causal priors may lead to over- or under-estimation in perceived causal relations in different circumstances, and that those priors can also impact users' confidence in their causal assessments. In addition, our results align with prior work, indicating that chart type may also affect causal inference. Using data from the studies, we develop a model to capture the interaction between causal priors and visualized associations as they combine to impact a user's perceived causal relations. In addition to reporting the study results and analyses, we provide an open dataset of causal priors for 56 specific concept pairs that can serve as a potential benchmark for future studies. We also suggest remaining challenges and heuristic-based guidelines to help designers improve visualization design choices to better support visual causal inference.
- Open Access
- 5 August 2024
- Published by SAGE Publications in Information Visualization
- Vol. 24 (1) , 24-41
A framework to improve causal inferences from visualizations using counterfactual operators
Exploratory data analysis of high-dimensional datasets is a crucial task for which visual analytics can be especially useful. However, the ad hoc nature of exploratory analysis can also lead users to draw incorrect causal inferences. Previous studies have demonstrated this risk and shown that integrating counterfactual concepts within visual analytics systems can improve users’ understanding of visualized data. However, effectively leveraging counterfactual concepts can be challenging, with only bespoke implementations found in prior work. Moreover, it can require expertise in both counterfactual subset analysis and visualization to implement the functionalities practically. This paper aims to help address these challenges in two ways. First, we propose an operator-based conceptual model for the use of counterfactuals that is informed by prior work in visualization research. Second, we contribute the Co-op library, an open and extensible reference implementation of this model that can support the integration of counterfactual-based subset computation with visualization systems. To evaluate the effectiveness and generalizability of Co-op, the library was used to construct two different visual analytics systems each supporting a distinct user workflow. In addition, expert interviews were conducted with professional visual analytics researchers and engineers to gain more insights regarding how Co-op could be leveraged. Finally, informed in part by these evaluation results, we distil a set of key design implications for effectively leveraging counterfactuals in future visualization systems.
- 5 August 2024
- Published by SAGE Publications in Information Visualization
- Vol. 24 (1) , 24-41
Open AccessA framework to improve causal inferences from visualizations using counterfactual operators
Exploratory data analysis of high-dimensional datasets is a crucial task for which visual analytics can be especially useful. However, the ad hoc nature of exploratory analysis can also lead users to draw incorrect causal inferences. Previous studies have demonstrated this risk and shown that integrating counterfactual concepts within visual analytics systems can improve users’ understanding of visualized data. However, effectively leveraging counterfactual concepts can be challenging, with only bespoke implementations found in prior work. Moreover, it can require expertise in both counterfactual subset analysis and visualization to implement the functionalities practically. This paper aims to help address these challenges in two ways. First, we propose an operator-based conceptual model for the use of counterfactuals that is informed by prior work in visualization research. Second, we contribute the Co-op library, an open and extensible reference implementation of this model that can support the integration of counterfactual-based subset computation with visualization systems. To evaluate the effectiveness and generalizability of Co-op, the library was used to construct two different visual analytics systems each supporting a distinct user workflow. In addition, expert interviews were conducted with professional visual analytics researchers and engineers to gain more insights regarding how Co-op could be leveraged. Finally, informed in part by these evaluation results, we distil a set of key design implications for effectively leveraging counterfactuals in future visualization systems.