Orbia: Do Generated Videos Form a Consistent 3D World?
Video generators serve as interactive worlds for exploration and simulation, yet realistic and visually appealing frames do not necessarily depict a consistent 3D world. Existing benchmarks assess selected geometric properties or use vision-language models to judge memory and consistency, leaving systematic 3D evaluation underexplored. We introduce Orbia, the first benchmark de
Reading in Plain English mode — toggle below to switch
Video generators serve as interactive worlds for exploration and simulation, yet realistic and visually appealing frames do not necessarily depict a consistent 3D world. Existing benchmarks assess selected geometric properties or use vision-language models to judge memory and consistency, leaving systematic 3D evaluation underexplored. We introduce Orbia, the first benchmark de
Evaluating the 3D consistency of generated videos is crucial for developing robust interactive world models and simulations. This benchmark addresses a critical gap in current evaluation methodologies, pushing the boundaries of what's considered 'good' in video generation beyond just visual appeal.