JMJiali Miao

Jiali Miao

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Jiali Miao has a total of 15 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Context-aware causal reasoning for explanatory visual question answering

    by Jiali Miao, Xiaoling Huang, Kui Yu, Yecheng Shi, Xiang Wang, Fuyuan Cao

  • Open Access

    Context-Aware Causal Reasoning for Explanatory Visual Question Answering

    by Jiali Miao, Kui Yu, Xiang Wang, Yecheng Shi, Fuyuan Cao, Richang Hong

    Explanatory Visual Question Answering (EVQA) is a multimodal reasoning task that answers visually relevant natural language questions and generates user-friendly multimodal explanations. Although current EVQA methods can generate grammatically sound and vocabulary appropriate explanations, they still face the challenge of explanatory illusion (i.e., wrong explanations arrive at correct answers).To address this issue, we propose a novel Context-Aware Causal Reasoning (CACR) algorithm.Specifically, we first leverage a Multimodal Large Language Model and design prompting strategies to generate high-quality image descriptions as complementary evidence for helping generate correct explanations.Then, we propose a Structural Causal Model (SCM) to establish the causal relationship among the description, the explanation, and the answer. Finally, we transform the SCM into a deep variational inference network framework that enables causal reasoning to ensure that the explanations are grounded in the visual evidence related to the answer.Extensive experiments show that CACR significantly reduces the risk of multimodal illusion in explanation compared to six state-of-the-art methods, outperforming the best baseline by 2.22\% on average in terms of explanation quality.

  • Causality guided co-attention network for visual question answering

    by Jiali Miao, Kui Yu, Baofu Fang, Le Wu, Richang Hong

  • Summary Graph Induced Invariant Learning for Generalizable Graph Learning

    by Xuecheng Ning, Yujie Wang, Kui Yu, Jiali Miao, Fuyuan Cao, Jiye Liang

    As a promising strategy to achieve generalizable graph learning tasks, graph invariant learning emphasizes identifying invariant subgraphs for stable predictions on biased unknown distribution by selecting the important edges/nodes based on their contributions to the predictive tasks (i.e., subgraph predictivity). However, the existing approaches solely relying on subgraph predictivity face a challenge: the learned invariant subgraph often contains numerous spurious nodes and shows poor connectivity, undermining the generalization power of Graph Neural Networks (GNNs). To tackle this issue, we propose a summary graph-induced Invariant Learning (SIL) model that innovatively adopts a summary graph to leverage both the subgraph connectivity and predictivity for learning strong connected and accurate invariant subgraphs. Specifically, SIL first learns a summary graph containing multiple strongly connected supernodes while maintaining structure consistency with the original graph. Second, the learned summary graph is disentangled into an invariant supernode and spurious counterparts to eliminate the interference of highly predictive edges and nodes. Finally, SIL identifies a potential invariant subgraph from the invariant supernode to accomplish generalization tasks. Additionally, we provide a theoretical analysis of the summary graph learning mechanism, guaranteeing that the learned summary graph is consistent with the original graph. Experimental results validate the effectiveness of the SIL model.