跳到正文
@rohanpaul_ai· @rohanpaul_ai · X·· 25 天前AI 评分30
AI 导读

LLM 常常低估自己需要多少信息,所以要测试它们何时停止追问,而不是只看答案准确率。 正确答案可能掩盖信息收集不足的问题。 模型可能凭借先验知识或猜对答案,而没有收集足够证据。 – arxiv. org/abs/2608.14808 标题:"Do LLMs Know What to Ask and When? Evaluating Multi-Turn Information Seeking"

正文

LLMs frequently underestimate how much information they need, so test when they stop instead of relying on answer accuracy alone.

A correct answer can hide poor information gathering.

The model may use prior knowledge or guess correctly without collecting enough evidence.

– arxiv. org/abs/2608.14808

Title: "Do LLMs Know What to Ask and When? Evaluating Multi-Turn Information Seeking"

来源:@rohanpaul_ai · x.com