TypeLLM 是一个开源的类型化 LLM 工作流模型，可将整个工作流作为一次 API 调用执行，把 JSON Schema 转为依赖图并在单一共享上下文上运行。它基于 SGLang 实现约束解码，能在不改动 Qwen 权重的情况下获得 schema 保证的输出，枚举、布尔和数字字段只能返回允许的候选值，并复用缓存前缀。
Open source meets type-safe AI, with TypeLLM.
Chat models give you a reply and decision models give you a choice, but TypeLLM is built to run your whole workflow in one API call.
Most production pipelines need something in between: several typed answers, some depending on others, a few that should exist only under certain conditions.
TypeLLM takes that whole shape as one JSON Schema and executes it as a dependency graph over a single shared context.
Typed LLM outputs, built in the open.
You can get schema-guaranteed outputs from a stock Qwen checkpoint without touching its weights.
The guarantee comes from how the requests are built and decoded.
TypeLLM sits on SGLang and turns a JSON Schema into constrained decoding: one scored token for an enum or boolean, bounded digits for numbers, and a dependency graph that reuses cached prefixes.
So a field can’t return a value outside its enum, because the decoder only considers the allowed candidates.
https://x.com/TypeLLM/status/2110281195380736292/video/1
Chat models return messages. Decision models return decisions. Workflow models execute workflows. TypeLLM introduces the first workflow model. Run an entire workflow in a single API call. Simpler, faster, cheaper. Try it now: https://typellm.ai/examples/ticket-workflow在 X 查看被引用的帖子
来源：Rohan Paul · x.com