AI 导读
一项斯坦福牵头的盲评研究对近 3000 组匿名对比显示,16 所法学院的教授在合同法学生问答中有 75% 的情况下更偏好 AI 生成的答案,而非同行教授的答案。研究还显示,教授判断 AI 答案在教学上有害的可能性远低于人类答案,分别为 3.5% 与 12%。作者引用研究说明团队测试了包括商业辅导工具和 Google NotebookLM 在内的多种系统,并称可以想象模型在 6-12 个月后的表现。
正文
A blind Stanford-led study of nearly 3,000 anonymized matchups found law professors across 16 schools preferred AI-generated answers to student contract-law questions over those written by fellow professors 75% of the time, and judged the AI responses far less likely to be pedagogically harmful (3.5% vs. 12%).
"The team tested a range of systems, including commercial tutoring tools and Google's NotebookLM."
Now imagine the performance of models in 6-12 months.
来源:@kimmonismus · x.com