BARD: A Structured Technique for Group Elicitation of Bayesian Networks to Support Analytic Reasoning
Open Access
- 19 June 2021
- journal article
- research article
- Published by Wiley in Risk Analysis
- Vol. 42 (6) , 1155-1178
Abstract
In many complex, real‐world situations, problem solving and decision making require effective reasoning about causation and uncertainty. However, human reasoning in these cases is prone to confusion and error. Bayesian networks (BNs) are an artificial intelligence technology that models uncertain situations, supporting better probabilistic and causal reasoning and decision making. However, to date, BN methodologies and software require (but do not include) substantial upfront training, do not provide much guidance on either the model building process or on using the model for reasoning and reporting, and provide no support for building BNs collaboratively. Here, we contribute a detailed description and motivation for our new methodology and application, Bayesian ARgumentation via Delphi (BARD). BARD utilizes BNs and addresses these shortcomings by integrating (1) short, high‐quality e‐courses, tips, and help on demand; (2) a stepwise, iterative, and incremental BN construction process; (3) report templates and an automated explanation tool; and (4) a multiuser web‐based software platform and Delphi‐style social processes. The result is an end‐to‐end online platform, with associated online training, for groups without prior BN expertise to understand and analyze a problem, build a model of its underlying probabilistic causal structure, validate and reason with the causal model, and (optionally) use it to produce a written analytic report. Initial experiments demonstrate that, for suitable problems, BARD aids in reasoning and reporting. Comparing their effect sizes also suggests BARD's BN‐building and collaboration combine beneficially and cumulatively.Keywords
All Related Versions
Funding Information
- Intelligence Advanced Research Projects Activity (Contract 2017‐16122000003)
This publication has 66 references indexed in Scilit:
- A proposed validation framework for expert elicited Bayesian NetworksExpert Systems with Applications, 2013
- Source Reliability and the Conjunction FallacyCognitive Science, 2011
- Reducing Overconfidence in the Interval Judgments of ExpertsRisk Analysis, 2010
- Inferring Hidden Causal StructureCognitive Science, 2010
- Avoiding GroupthinkPsychological Science, 2009
- Locating Intersections for Autonomous Vehicles: A Bayesian Network ApproachETRI Journal, 2007
- The Advantage of Timely Intervention.Journal of Experimental Psychology: Learning, Memory, and Cognition, 2004
- Bayesian belief nets for managing expert judgement and modelling reliabilityQuality and Reliability Engineering International, 2001
- Causal learning mechanisms in very young children: Two-, three-, and four-year-olds infer causal relations from patterns of variation and covariation.Developmental Psychology, 2001
- Spurious Correlation: A Causal InterpretationJournal of the American Statistical Association, 1954