preprint · arXiv (cs.GR, cs.CV), 2026 · Oct 29, 2026
TalkFlow: Structured Latent Flow Matching for Speech Driven Holistic Motion Generation
Xinmu Wang, Fumi Honda, Xiang Gao, Xianfeng Gu, Xiyun Song, Heather Yu
In plain English
Generates facial expression, hand gestures and body motion from speech using separate latent streams for upper body, lower body and face that are lightly coupled. On BEAT2 the authors report better facial accuracy, gesture quality and speech-motion sync, and user studies favor it over earlier methods.
gesture generation
audio-driven animation
digital humans