跳到正文
@SemiAnalysis_· @SemiAnalysis_ · X·· 21 天前AI 评分24
AI 导读

SemiAnalysis 发现 Astra 平均工具调用次数为 1.27 次,高于 Sol 的 1.04 次,尽管 Astra 使用工具的回答占比更低(93.5% vs 96.7%)。该数据来自其特定工作负载,Astra 观察窗口较短,早期 GPT 队列样本量远小于 Sol,因此难以与其他数据直接比较。

正文

Astra's higher average is interesting because it used tools in a smaller share of responses than Sol, 93.5% versus 96.7%. But when it did use tools, we found it averaged more calls: 1.27 versus 1.04.

As a reminder, these are representative of our specific workloads making it hard to compare with other data. The models tend see different task classifications, Astra's observation window is short, and the earlier GPT cohorts are much smaller than Sol's.

Do you see similar patterns in your own workflows? (2/2)
https://t.co/QESgNC9Xjz

来源:@SemiAnalysis_ · x.com