Skip to main content
GameDev.net gamedev.net

Evaluation News

The latest Evaluation coverage curated for game developers.

Toward Uncertainty Quantification in Modern Art

A new graphics paper tackles a problem most generative pipelines still flatten into a single score: how to describe uncertainty across multiple seeds. Using 1,000 videos from 250 modern-art captions, …

Research arXiv cs.GR · 1 month, 1 week ago
Echo-Memory: A Controlled Study of Memory in Action World Models

A controlled study of action-conditioned world models finds that memory design matters more than replay quality suggests. With a shared video diffusion backbone and fixed action interface, the authors show …

Research arXiv cs.GR · 3 months, 1 week ago
QQJ: Quantifying Qualitative Judgment for Scalable and Human-Aligned Evaluation of Generative AI

For teams using generative AI in production, the big shift here is moving evaluation from vague “looks good” judgments to a rubric-driven system that can be scaled. QQJ calibrates LLM …

Research arXiv cs.GR · 3 months, 4 weeks ago
WorldScore: A Unified Evaluation Benchmark for World Generation

The WorldScore benchmark introduces a unified evaluation standard for world generation in games. It features 3,000 test examples across various world types, focusing on controllability, quality, and dynamics. This benchmark …

Research arXiv cs.GR · 9 months, 2 weeks ago