Abstract
As AI increasingly supports human decision-making, designing clear and usable explanations has become a key challenge. Explainable Artificial Intelligence (XAI) aims to address this challenge, yet it remains unclear which explanation characteristics contribute to effective human-AI interaction. Following PRISMA guidelines, this systematic review synthesizes evidence from 161 empirical studies that directly compared multiple XAI implementations using human-centered evaluation metrics. Studies were analyzed across four explanation aspects: method, content, format, and interaction. Results were highly heterogeneous and often showed limited or non-significant differences between explanation implementations. Variations in explanation methods and content rarely produced consistent effects on user outcomes. In contrast, user-facing design choices, particularly explanation format and interaction, showed more consistent effects on user-related outcomes. Overall, the findings suggest that explanation effectiveness depends less on the underlying algorithm and more on how explanations are presented and experienced, highlighting the importance of a user-centered design perspective for XAI research and practice.