AI 导读
Georgi Gerganov 宣布 Decision models 已可在 llama.cpp 中使用，最新构建提供 /v1/systemone 端点。用户可在本地以高效、私密的方式运行 Jev 风格推理，目前支持多个开放模型并会持续增加，详情见 https://huggingface.co/blog/ggml-org/decision-models-in-llamacpp。
正文
Decision models in llama.cpp are now available
The `/v1/systemone` endpoint is available in the latest llama builds. Use it to do Jev-style inference locally, efficiently and privately. Multiple open models are supported with more to come.
https://huggingface.co/blog/ggml-org/decision-models-in-llamacpp
来源：Georgi Gerganov · x.com