Abstract
Background: Depression affects over 280 million people worldwide, yet diagnosis still depends on subjective clinical interviews and self-report questionnaires that are vulnerable to recall bias, social desirability effects, and limited access to trained professionals. Multimodal deep learning may enable more objective depression detection by combining behavioral, verbal, and physiological signals from multiple data sources. Methods: This systematic review followed the PRISMA 2020 guidelines. We searched IEEE Xplore, ACM Digital Library, Web of Science, SpringerLink, and ScienceDirect for peer-reviewed studies published between January 2018 and August 2025. Eligible studies used at least two measured input modalities for depression classification or severity assessment with quantitative evaluation. From an initial pool of 120 records, screening and eligibility assessment yielded 50 included studies. Results: Across clinical, social media, and laboratory settings, multimodal systems outperformed unimodal baselines. Audio-video fusion and electroencephalography combined with facial video or eye tracking produced the largest gains. Alignmentaware audio-text models improved accuracy when reliable timestamps were available. Audio-video pipelines on standard corpora reached precision values near 95%, with sensitivity and specificity frequently above 80%, though metric reporting varied across studies. Accuracy generally plateaued beyond two or three modalities; well-optimized bimodal systems often matched or outperformed larger combinations while remaining easier to deploy. Among fusion strategies, hybrid approaches that combine feature-level and decision-level information most often achieved the highest accuracy and stability, and attention-based or transformer-based fusion added gains in both performance and interpretability. Conclusions: Multimodal deep learning can improve the objectivity of depression assessment, but clinical adoption requires progress on several fronts: standardized evaluation protocols and metrics, transparent handling of temporal alignment and missing modalities, external validation in diverse populations, fairness and uncertainty evaluation, and deployment-oriented research on privacy-preserving and on-device inference. This systematic review was not prospectively registered.