Mixture Of Experts News
The latest Mixture Of Experts coverage curated for game developers.
MMOE: Modernizing Diffusion Transformers with Efficient Expert Design
MMOE brings sparse-expert routing to diffusion transformers with a stronger focus on efficiency, not just raw parameter growth. Trained on a single 8×H100 node for 400k steps, it hit lower …
Research
arXiv cs.GR
·
1 month, 3 weeks ago