Diffusion Models News
The latest Diffusion Models coverage curated for game developers.
arXiv cs.GR details DSD, a diffusion-based skill discovery method that learns a wider set of reusable humanoid motor skills. For game teams building animation or AI-driven characters, the pitch is …
A new template-generation model, InterIL, jointly creates a background image and foreground layout from text instead of building them in sequence. For UI, marketing, and tools teams, the practical hook …
SceneHI brings high-resolution, 3D-consistent scene texturing with controllable illumination into a single generative pipeline. The system lifts priors from 2D diffusion models onto 3D objects, then bakes geometry-aware shadows directly …
UniMate aims to remove a major bottleneck in character animation: motion generation for arbitrary rigs. The model takes a rigged 3D asset and a text prompt, then produces articulated motion …
LightBridge aims to make relighting 3D Gaussian Splatting assets a one-pass process instead of a per-scene optimization job. The system uses a feed-forward generative pipeline plus a new relighting dataset …
DReSG tackles a familiar 3D Gaussian Splatting problem: how to add strong reference-driven style without wrecking view consistency. The method turns diffusion outputs into residual targets and feeds them back …
A new framework cuts the cost of building urban segmentation training data by turning rough synthetic scenes into target-aligned images. It adapts an off-the-shelf diffusion model with only imperfect pseudo-labels, …
EditStream folds text-to-video, image-to-video, video-to-video, editing propagation, reference-guided edits, and camera pose changes into one DiT-based system. The big shift for developers is its few-step autoregressive streaming setup, aimed at …
ACM Transactions on Graphics has published an erratum for Loops2Roofs, the diffusion-based roof generation system built around a loop representation. The correction lands in Volume 45, Issue 5, dated October …
Disney Research Studios has built a diffusion-based system that can generate drummer motion from audio with centimeter-level stick accuracy while keeping the body movement natural. The model separates skeletal motion …
RGBX-Next turns G-buffers into a controllable input for generative rendering, aiming to bridge the gap between diffusion models and traditional 3D pipelines. The system can synthesize realistic images, video, and …
RealMat combines Stable Diffusion XL with reinforcement learning to generate more believable material maps for 3D authoring. The pipeline starts from synthetic 2×2 material grids, then pushes the model toward …
A new study shows that fine-tuning open-source diffusion models on 1,000 captioned nuclear-energy images can materially improve text-to-image accuracy for specialized technical prompts. SDXL benefited the most, while SD-v3.5-Medium saw …
A new diffusion pipeline can generate triply periodic minimal surfaces with far tighter geometric control than earlier TPMS tools. The system combines a 18K-surface dataset, a Fourier latent space that …
A new single-image avatar pipeline can generate photorealistic 3D head models with real-time expression control. S-Avatar combines diffusion-guided 3D Gaussian splatting with FLAME alignment to improve view consistency under motion …
Disney Research Studios has unveiled Two2Four, a human-to-quadruped puppeteering system that turns ordinary human motion into plausible animal animation. The pipeline uses a two-stage diffusion model trained on quadruped motion …
Two2Four is a new human-to-quadruped puppeteering system that turns ordinary human motion into plausible animal animation. Built on a two-stage diffusion model trained only on quadruped motion, it aims to …
MMOE brings sparse-expert routing to diffusion transformers with a stronger focus on efficiency, not just raw parameter growth. Trained on a single 8×H100 node for 400k steps, it hit lower …
A new black-box inverse rendering pipeline, Feature-Informed Diffusion Evolution, skips gradients and hand-tuned initialization entirely. It uses ViT features to steer a diffusion model, then tightens candidates with CMA-ES. The …
A new neural motion-blending system can interpolate animation across characters with different skeleton topologies, not just near-identical rigs. It pairs a semantic motion encoder with a diffusion decoder to reconstruct …