Skip to main content
GameDev.net gamedev.net
2 sources covering this story

Track the Noise, Move the World:3D-Grounded Motion-Consistent Noise for Controllable Video Generation

A new controllable video generation framework, UniCaMo, tackles one of the hardest problems in diffusion-based video: keeping object motion and camera motion coherent at the same time. It does this by shaping the input noise itself with 3D-grounded track warping and spherical noise sampling, instead of adding extra control branches. The result is state-of-the-art quality and motion control on standard benchmarks.

First reported 2 months, 3 weeks ago • ai video generation diffusion models motion control camera control
Want to discuss what this means for developers?
Open discussion
PRIMARY SOURCE
arXiv cs.GR arXiv cs.GR

Track the Noise, Move the World:3D-Grounded Motion-Consistent Noise for Controllable Video Generation

2 months, 3 weeks ago Read source
arXiv cs.GR arXiv cs.GR 1% match

Prior-First, Condition-Second: Scalable and Controllable Hand Motion Completion

2 months, 3 weeks ago Read source