Google DeepMind 展示了由 Gemini 驱动的 AI 鼠标指针实验演示,可结合指向、语音和自然简写直接操作屏幕内容。演示中用户指向一张建筑图片并说 show me the route 即可获得路线,无需复制粘贴、打开聊天窗口或编排提示词。首批演示已在 Chrome 和 Google AI Studio 上线。
Google DeepMind just reinvented the mouse pointer.
Since Doug Engelbart's demo in 1968, the little arrow on your screen has barely changed. Until now.
The new AI pointer sees what you're pointing at, understands the context, and responds to your voice. You point at an image of a building, say "show me the route," and that's it.
No copy-paste, no chat window, no prompt gymnastics.Powered by Gemini. First demos are live in Chrome and Google AI Studio. This might be the beginning of the end for the classic chatbot interface.
really really cool! Im using wispr flow right now but this is literally the next step
We’re reimagining a 50-year-old interface - the mouse pointer - with AI. 🖱️ These experimental demos show how people can intuitively direct Gemini on their screens using motion, speech, and natural shorthand to get things done 🧵 Video在 X 查看被引用的帖子
来源:@kimmonismus · x.com