E2078 - Generative World Renderer at the Speed of Play

🤗 Upvotes: 65 | cs.CV

Authors:
Guixu Lin, Zheng-Hui Huang, Siqi Yang, Ming-Hsuan Yang, Kaipeng Zhang, Zhixiang Wang

Title:
Generative World Renderer at the Speed of Play

Arxiv:
http://arxiv.org/abs/2607.18703v1

Abstract:
Generative world renderer AlayaRenderer receives structured world states exported from physics engines and synthesizes RGB frames. Unlike models that generate frames from text/control-hints prompts, AlayaRenderer preserves scene structure without altering the underlying world dynamics. This demonstrates an alternative path toward interactive world modeling and user-controllable play. However, the original AlayaRenderer is too computationally expensive for...