Lip Sync News
The latest Lip Sync coverage curated for game developers.
Seeing Speech: Learning Visible Articulatory Dynamics for Speech-Driven 3D Facial Animation
arXiv cs.GR details a new speech-driven 3D facial animation method that aims to make lip motion look more physically believable. The model separates visible articulation into spreading, opening, and protrusion, …
Research
arXiv cs.GR
·
2 weeks, 2 days ago
Unison: Harmonizing Motion, Speech, and Sound for Human-Centric Audio-Video Generation
A new arXiv paper tackles a familiar multimodal headache: keeping motion, speech, and sound effects aligned in human-centric video generation. Unison splits speech from SFX in the audio stream and …
Research
arXiv cs.GR
·
5 months ago
Supervising 3D Talking Head Avatars with Analysis-by-Audio-Synthesis
The introduction of THUNDER, a new framework for 3D talking head avatars, promises to enhance lip-sync accuracy while maintaining expressive facial animations. This innovation is particularly relevant for artists and …
Research
arXiv cs.GR
·
8 months, 2 weeks ago