Emergent Morphing Attack Detection in Open Multi-modal Large Language Models
Preprint
Abstract
Face morphing attacks threaten biometric verification, yet most morphing attack detection (MAD) systems require task-specific training and generalize poorly to unseen attack types. Meanwhile, open-source multimodal large language models (MLLMs) have demonstrated strong visual-linguistic reasoning, but their potential in biometric forensics remains underexplored. In this paper, we present the first systematic zero-shot evaluation of open-source MLLMs for single-image MAD, using publicly available weights and a standardized, reproducible protocol. Across diverse morphing techniques, many MLLMs show non-trivial discriminative ability without any fine-tuning or domain adaptation, and LLaVA1.6-Mistral-7B achieves state-of-the-art performance, surpassing highly competitive task-specific MAD baselines by at least 23% in terms of equal error rate (EER). The results indicate that multimodal pretraining can implicitly encode fine-grained facial inconsistencies indicative of morphing artifacts, enabling zero-shot forensic sensitivity. Our findings position open-source MLLMs as reproducible, interpretable, and competitive foundations for biometric security and forensic image analysis. This emergent capability also highlights new opportunities to develop state-of-the-art MAD systems through targeted fine-tuning or lightweight adaptation, further improving accuracy and efficiency while preserving interpretability. To support future research, all code and evaluation protocols will be released upon publication.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Empowering Morphing Attack Detection Using Interpretable Image-Text Foundation Model2025
- SelfMAD: Enhancing Generalization and Robustness in Morphing Attack Detection via Self-Supervised Learning2025
- Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensics2024
- Generalized Single-Image-Based Morphing Attack Detection Using Deep Representations from Vision Transformer2024
- Intern VL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks2024
- Revelio: A Modular and Effective Framework for Reproducible Training and Evaluation of Morphing Attack DetectorsIEEE Access, 2023
- Face morphing attacks and face image quality: The effect of morphing and the unsupervised attack detection by qualityIET Biometrics, 2022
- MixFaceNets: Extremely Efficient Face Recognition Networks2021
- Attention Aware Wavelet-based Detection of Morphed Face Images2021
- PW-MAD: Pixel-Wise Supervision for Generalized Face Morphing Attack Detection2021