Quantify the Causes of Causal Emergence: Critical Conditions of Uncertainty and Asymmetry in Causal Structure
Authors:
Preprint
Abstract
Beneficial to advanced computing devices, models with massive parameters are increasingly employed to extract more information to enhance the precision in describing and predicting the patterns of objective systems. This phenomenon is particularly pronounced in research domains associated with deep learning. However, investigations of causal relationships based on statistical and informational theories have posed an interesting and valuable challenge to large-scale models in the recent decade. Macroscopic models with fewer parameters can outperform their microscopic counterparts with more parameters in effectively representing the system. This valuable situation is called "Causal Emergence." This paper introduces a quantification framework, according to the Effective Information and Transition Probability Matrix, for assessing numerical conditions of Causal Emergence as theoretical constraints of its occurrence. Specifically, our results quantitatively prove the cause of Causal Emergence. By a particular coarse-graining strategy, optimizing uncertainty and asymmetry within the model's causal structure is significantly more influential than losing maximum information due to variations in model scales. Moreover, by delving into the potential exhibited by Partial Information Decomposition and Deep Learning networks in the study of Causal Emergence, we discuss potential application scenarios where our quantification framework could play a role in future investigations of Causal Emergence.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- A Brief Overview of ChatGPT: The History, Status Quo and Potential Future DevelopmentIEEE/CAA Journal of Automatica Sinica, 2023
- A World-Self Model Towards Understanding IntelligenceIEEE Access, 2022
- A Survey on Causal InferenceACM Transactions on Knowledge Discovery From Data, 2021
- An Algorithmic Information Calculus for Causal Discovery and Reprogramming SystemsiScience, 2019
- Unique information via dependency constraintsJournal of Physics A: Mathematical and Theoretical, 2018
- Causal Emergence and Epiphenomenal EmergenceErkenntnis, 2018
- Low-algorithmic-complexity entropy-deceiving graphsPhysical Review E, 2017
- Quantifying causal emergence shows that macro can beat microProceedings of the National Academy of Sciences, 2013
- A mathematical theory of strong emergence using multiscale varietyComplexity, 2004
- The minicolumn hypothesis in neuroscienceBrain, 2002