Skip to content
← Back to Research

preprint · arXiv · Jan 15, 2026

RSATalker: Realistic Socially-Aware Talking Head Generation for Multi-Turn Conversation

Peng Chen, Xiaobao Wei, Yi Yang, Naiming Yao, Hui Chen, Feng Tian

In plain English

A talking-head pipeline that drives a 3D facial mesh from speech, binds Gaussians to the mesh facets for rendering, and conditions the output on the social relationship between the speakers — blood versus non-blood, equal versus unequal standing — on the premise that the same sentence should be delivered differently to a manager than to a sibling. The authors also release a speech-mesh-image dataset annotated with those relationships, which is arguably the more reusable contribution. The abstract claims state-of-the-art realism and social awareness but reports no metrics, so the performance claim cannot be checked without the full paper.

talking head generation
gaussian splatting
social behavior
persona design
Read the source ↗

Related research