Skip to main content
GameDev.net gamedev.net

Speech Driven Animation News

The latest Speech Driven Animation coverage curated for game developers.

Seeing Speech: Learning Visible Articulatory Dynamics for Speech-Driven 3D Facial Animation

arXiv cs.GR details a new speech-driven 3D facial animation method that aims to make lip motion look more physically believable. The model separates visible articulation into spreading, opening, and protrusion, …

Research arXiv cs.GR · 2 weeks, 3 days ago
ETHead: Generating Expressive 3D Facial Animation and Head Movement from Speech

ETHead is a new speech-to-animation method aimed at making 3D talking heads look less robotic and more emotionally alive. It uses self-distillation from large-scale 2D talking videos to train a …

Research arXiv cs.GR · 2 months, 1 week ago
StreamTalk: Streaming Co-Speech Gesture Generation with Key-Pose Anchoring

StreamTalk tackles a familiar real-time animation problem: gesture drift in streaming co-speech generation. The system adds a key-pose anchor at the end of each clip, then retrieves and refines motion …

Research arXiv cs.GR · 2 months, 1 week ago
KM-Speaker: Keypoint-Based Style Control for High-Quality Speech-Driven 3D Facial Animation and Dialogue Localization

For teams doing facial animation or localization, this paper tackles a real production gap: getting both believable speech-driven motion and usable style control from a reference performance. KM-Speaker separates lip …

Research arXiv cs.GR · 3 months, 2 weeks ago