AI 导读
混合计算将工作负载拆分到云端模型和 Mac 上的本地模型之间。本地推理必须跟上任务其余部分的节奏。 MLX-LM 是通用框架，而 Lily 是专为这一推理工作负载打造的。https://t.co/MFsA8LgK0O
正文
Hybrid compute splits work between cloud models and a local model on the Mac. Local inference must keep pace with the rest of the task.
MLX-LM is a general-purpose framework, while Lily is purpose-built for this inference workload. https://t.co/MFsA8LgK0O
来源：@perplexity_ai · x.com