Learning Bayesian Networks That Enable Full Propagation of Evidence
Open Access
- 8 July 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 124845-124856
Abstract
This paper builds on recent developments in Bayesian network (BN) structure learning under the controversial assumption that the input variables are dependent. This assumption can be viewed as a learning constraint geared towards cases where the input variables are known or assumed to be dependent. It addresses the problem of learning multiple disjoint subgraphs that do not enable full propagation of evidence. This problem is highly prevalent in cases where the sample size of the input data is low with respect to the dimensionality of the model, which is often the case when working with real data. The paper presents a novel hybrid structure learning algorithm, called SaiyanH, that addresses this issue. The results show that this constraint helps the algorithm to estimate the number of true edges with higher accuracy compared to the state-of-the-art. Out of the 13 algorithms investigated, the results rank SaiyanH 4 th in reconstructing the true DAG, with accuracy scores lower by 8.1% (F1), 10.2% (BSF), and 19.5% (SHD) compared to the top ranked algorithm, and higher by 75.5% (F1), 118% (BSF), and 4.3% (SHD) compared to the bottom ranked algorithm. Overall, the results suggest that the proposed algorithm discovers satisfactorily accurate connected DAGs in cases where other algorithms produce multiple disjoint subgraphs that often underfit the true graph.Keywords
All Related Versions
Funding Information
- Engineering and Physical Sciences Research Council (EPSRC) Fellowship Project on Bayesian Artificial Intelligence for Decision Making under Uncertainty (EP/S001646/1)
- The Alan Turing Institute, U.K., through the EPSRC (EP/N510129/1)
This publication has 23 references indexed in Scilit:
- A hybrid algorithm for Bayesian network structure learning with application to multi-label learningExpert Systems with Applications, 2014
- Incorporating expert knowledge when learning Bayesian network structure: A medical case studyArtificial Intelligence in Medicine, 2011
- Bayesian network learning algorithms using structural restrictionsInternational Journal of Approximate Reasoning, 2007
- The max-min hill-climbing Bayesian network structure learning algorithmMachine Learning, 2006
- Reply to Humphreys and Freedman's Review of Causation, Prediction, and SearchThe British Journal for the Philosophy of Science, 1997
- In Search of the Philosopher's Stone: Remarks on Humphreys and Freedman's Critique of Causal DiscoveryThe British Journal for the Philosophy of Science, 1997
- The Grand LeapThe British Journal for the Philosophy of Science, 1996
- Learning Bayesian networks: The combination of knowledge and statistical dataMachine Learning, 1995
- An Algorithm for Fast Recovery of Sparse Causal GraphsSocial Science Computer Review, 1991
- The ALARM Monitoring System: A Case Study with two Probabilistic Inference Techniques for Belief Networks1989