Generalized Audio-Driven Synthesis of Precise Drummer Motion

Disney Research Studios has built a diffusion-based system that can generate drummer motion from audio with centimeter-level stick accuracy while keeping the body movement natural. The model separates skeletal motion from stick placement, then trains on augmented data so it can handle messy, in-the-wild audio instead of only curated performances. For animation teams, that points to more reliable music-driven motion for games, film, and interactive experiences.