跳到正文
@berryxia· @berryxia · X·· 2026-05-27AI 评分37
AI 导读

基于 Apple MLX 框架的本地 AI 项目 oMLX 发布 v0.3.11,由一位有全职工作的 solo 开发者维护,目标是让端侧模型在 Apple 设备上提速。过去几轮更新以稳定性为头等大事,尤其针对高内存压力下的表现,作者希望用户再测测这一版本。其初心是让刚买 MacBook 的人也能开箱即用本地模型,无需看文档、调参数,甚至模型下载时就能开始对话。

正文

我最近在Mac上折腾本地AI时,发现一个叫oMLX的项目一直在默默更新。

它的作者是个有全职工作的solo开发者。

刚刚发布了v0.3.11版本。

这个也是基于Apple MLX 框架来延展出来的框架,让端侧模型在Apple 设备提速。

过去几轮更新,他把稳定性当成了头等大事。

尤其是高内存压力下的表现,这次他希望大家再多测测。

他的初心其实很简单。

哪怕你昨天刚买了MacBook,也能立刻打开工具就用本地模型。

不用看文档,不用调参数,不用等半天。

整个流程像用原生App一样自然流畅。

甚至模型还在下载的时候,你已经能开始对话了。

在大家都在卷参数规模和推理速度的时候,他却把精力全放在了让普通人真正用得爽这件事上。

这可能是本地AI真正走向普及的最关键一步。

项目地址见评论区👇

引用Jun Kim (@jundotkim)@jundotkim
Just released oMLX v0.3.11. The last few updates have focused on stability as my top priority, and I'm planning to ship new features, including pending PRs, in the next release. (Huge thanks to everyone who's sent support and contributions!) If you've run into stability issues with oMLX under high memory pressure, I'd really appreciate it if you gave this version another test. github.com/jundot/omlx/relea… As a solo developer with a main job on the side, maintaining a project that's grown bigger than I expected isn't always easy, but getting to grow it together with the open source community has been a genuinely joyful experience. oMLX aims to deliver a Local AI experience that even my friend who bought a MacBook just yesterday can pick up and use right away. I hope oMLX makes it easy for everyone to run Local AI on their Mac. Is there a specific new feature you'd love to see in oMLX? Feature suggestions are always welcome!
在 X 查看被引用的帖子

来源:@berryxia · x.com