AudioLift: Audio-Driven Single Image to Full-Head Gaussian Avatar via Multi-view Video Generation

In plain English

Most 3D talking avatar systems are built on parametric face models such as 3DMM or FLAME, which struggle with extreme expressions and anything worn on the head. This method skips the face model entirely: it first generates synchronised multi-view video from a single portrait and audio, then reconstructs a full-head Gaussian avatar from those views, tolerating the inconsistencies between them. For practitioners, the interesting claim is accessories and wide expression range from one photo with no per-person optimisation step.