preprint · arXiv · Dec 4, 2025
Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length
Yubo Huang, Hailong Guo, Fangtai Wu, Weiqiang Wang, Shifeng Zhang, Shijie Huang, Qijun Gan, Lin Liu, Sirui Zhao, Enhong Chen, Jiaming Liu, Steven Hoi
In plain English
This tackles the hardest part of real-time avatar video: keeping a large diffusion model streaming indefinitely without the face drifting or degrading. The authors distil a 14-billion-parameter bidirectional model into a causal few-step one and spread the denoising steps across GPUs as an asynchronous pipeline, reporting 45 FPS and 1.21 seconds to first frame on five H800 GPUs, with stable generation past 10,000 seconds; they also release a long-form benchmark, GenBench. The figure worth holding onto when costing a deployment is the hardware: this quality of infinite-length streaming currently assumes a five-GPU server behind each stream, and all numbers are the authors' own.
Related research
- InteractiveAvatar: Real-Time Streaming Video Generation for Consistent and Intent-Aware Avatars
- Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation with Asynchronous Dual-Stream and Human-Centric Preference Distillation
- EmbodiedHead: Real-Time Listening and Speaking Avatar for Conversational Agents