跳到正文
@OpenRouter· @OpenRouter · X·· 19 天前AI 评分13
AI 导读

4/ 我们给的任务是读取传入请求,并将其标记为 30 种任务类型之一。这是一个范围明确的决策,在生产系统中不断发生,因此延迟和成本非常重要。 所有五个模型都在相同的 200 个案例上按顺序、无状态地进行评估。

正文

4/ The task we gave was to read incoming requests and label it as one of 30 task types. It's a tightly scoped decision, made constantly in production systems, so latency and cost matters a lot.

All five models are evaluated across the same 200 cases sequentially & statelessly.

来源:@OpenRouter · x.com