MegaAvatar: Controllable Talking Avatar Generation

In plain English

Audio-plus-reference-image avatar generation gives you a talking face but almost no control over the body. This framework adds SMPL-X 3D guidance on top of a video model so body pose and head motion can be directed explicitly, with separate audio and face attention modules for expression and identity. An audio-to-SMPL-X model predicts the motion sequence when the user supplies no pose input, so it still works audio-only. Note the abstract reports no quantitative metrics or benchmark comparisons, so treat the quality claims as unevaluated for now.