Expression-tailored talking face generation with adaptive cross-modal weighting

The key of talking face generation is to synthesize the identity-preserving natural facial expressions with accurate audio-lip synchronization. To accomplish this, it requires to disentangle and fuse the latent features from multiple modalities, including the visual identity, facial expressions, and audio,