AI 导读
LLM 常常低估自己需要多少信息,所以要测试它们何时停止追问,而不是只看答案准确率。 正确答案可能掩盖信息收集不足的问题。 模型可能凭借先验知识或猜对答案,而没有收集足够证据。 – arxiv. org/abs/2608.14808 标题:"Do LLMs Know What to Ask and When? Evaluating Multi-Turn Information Seeking"
正文
LLMs frequently underestimate how much information they need, so test when they stop instead of relying on answer accuracy alone.
A correct answer can hide poor information gathering.
The model may use prior knowledge or guess correctly without collecting enough evidence.
– arxiv. org/abs/2608.14808
Title: "Do LLMs Know What to Ask and When? Evaluating Multi-Turn Information Seeking"
来源:@rohanpaul_ai · x.com