Zhehao Liang
Zhehao Liang has a total of 2 co-authors. Here are the top co-authors by number of shared publications:
Lu Liu
1 shared publication- Tao Peng
College of Computer Science and Technology, Jilin University, Changchun, 130012, Jilin, China; College of Software, Jilin University, Changchun, 130012, Jilin, China; Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, 130012, Jilin, China
1 shared publication
Latest Publications
- Open Access
- 22 September 2026
- Published by Elsevier in SSRN Electronic Journal
Diagnosing Disagreement Observability Collapse in LLM-based Structured KnowledgeVerification: Restoring Uncertainty Signals through Task-Aligned Multi-View Verification
Large language models are increasingly used for structured knowledge verification, where reliable knowledge verification is essential for identifying potentially incorrect predictions. Existing disagreement-based uncertainty methods assume that repeated outputspreserve observable variation. However, semantically plausible false claims may produce unanimous but incorrect predictions, causing disagreement observability collapse before uncertainty computation. On a controlled stress test, SC-3 has Zero-Entropy Ratesof 83.9% on deceptive examples and 76.5% on 1,491 aligned examples. Its Wrong-Unanimity Rate (WUR) is 67.5% (326/483 errors). As a diagnostic intervention, Multi-View Conflict Aggregation (MVCA) decomposes verification into factual, semantic,and structural dimensions rather than introducing arbitrary prompt diversity. MVCA reduces the corresponding Zero-Entropy Rates to 39.1% and 55.9% and has a WUR of 39.1% (175/448 errors). It obtains AURC 0.234 with three calls, compared with 0.231 for 20 homogeneous samples. The benefit reverses on weaker backbones that do not respond differently to the assigned dimensions. Reliable LLM-based knowledge verification depends on whether diagnostically useful disagreement remains observable before uncertainty aggregation. Task-aligned verification decomposition helps only when the backbone can distinguish the relevant verification dimensions.
- 22 September 2026
- Published by Elsevier in SSRN Electronic Journal
Open AccessDiagnosing Disagreement Observability Collapse in LLM-based Structured KnowledgeVerification: Restoring Uncertainty Signals through Task-Aligned Multi-View Verification
Large language models are increasingly used for structured knowledge verification, where reliable knowledge verification is essential for identifying potentially incorrect predictions. Existing disagreement-based uncertainty methods assume that repeated outputspreserve observable variation. However, semantically plausible false claims may produce unanimous but incorrect predictions, causing disagreement observability collapse before uncertainty computation. On a controlled stress test, SC-3 has Zero-Entropy Ratesof 83.9% on deceptive examples and 76.5% on 1,491 aligned examples. Its Wrong-Unanimity Rate (WUR) is 67.5% (326/483 errors). As a diagnostic intervention, Multi-View Conflict Aggregation (MVCA) decomposes verification into factual, semantic,and structural dimensions rather than introducing arbitrary prompt diversity. MVCA reduces the corresponding Zero-Entropy Rates to 39.1% and 55.9% and has a WUR of 39.1% (175/448 errors). It obtains AURC 0.234 with three calls, compared with 0.231 for 20 homogeneous samples. The benefit reverses on weaker backbones that do not respond differently to the assigned dimensions. Reliable LLM-based knowledge verification depends on whether diagnostically useful disagreement remains observable before uncertainty aggregation. Task-aligned verification decomposition helps only when the backbone can distinguish the relevant verification dimensions.