Google DeepMind 发布 Genie 4,称其为迄今最真实、交互性最强的世界模型。用户可用自然语言实时改变天气、移动镜头或向环境添加新元素,并动态操控音景。Gemini 充当模拟的大脑,负责将请求转化为动作、规划复杂事件、跟踪场景进展并随剧情调整;Genie 4 还引入环境音和可实时自适应的交互式人物对话。
Introducing Genie 4 from @GoogleDeepMind, our most realistic and interactive world model yet 🌍
Now you can use natural language to dynamically steer the world and its soundscape in real-time, whether you're changing the weather, moving the camera, or introducing new elements to the environment.
So, how does the model do that?
Behind the scenes, Gemini acts as the "brain" of the simulation. It translates your requests into actions, plans out complex events, watches the scene unfold to keep track of what's happening, and adjusts as you change the story. Genie 4 also introduces ambient audio and real-time interactive human dialogue that adapts on the fly.
来源:Google AI · x.com