AI 导读
4/ 我们给的任务是读取传入请求,并将其标记为 30 种任务类型之一。这是一个范围明确的决策,在生产系统中不断发生,因此延迟和成本非常重要。 所有五个模型都在相同的 200 个案例上按顺序、无状态地进行评估。
正文
4/ The task we gave was to read incoming requests and label it as one of 30 task types. It's a tightly scoped decision, made constantly in production systems, so latency and cost matters a lot.
All five models are evaluated across the same 200 cases sequentially & statelessly.
来源:@OpenRouter · x.com