AI 导读
端侧运行,在 Android 上,数据不离开手机。MiniCPM5-2B 通过 llama.cpp GGUF 在 @RunAnywhereAI 上推理 8-ball 问题,然后编写出能通过验证的代码。 这就是我们想要的边缘部署方案。感谢运行 @ShubhamMal72313 https://t.co/diAb65vGs3
正文
On-device, on Android, nothing leaving the phone. MiniCPM5-2B via llama.cpp GGUF in @RunAnywhereAI reasoning through the 8-ball problem, then writing code that checks out.
This is the edge setup we wanted. Thanks for running it @ShubhamMal72313 https://t.co/diAb65vGs3
来源:@OpenBMB · x.com