Multimodal Deepfake Detection via Audio-Visual Causal Divergence

Abstract

Frames deepfake detection as identifying broken causal links between audio and visual modalities. Uses WhisperX forced phoneme alignment, CLIP ViT encoders, and Riemannian manifold representations to measure cross-modal synchrony divergence.