一项覆盖 11 家美国知识产权所 133 名专利律师的三个月随机试验发现,AI 辅助提升了专利起草质量,初级律师获益最大,在 10 天和 90 天分别提升 +0.58 SD 和 +0.60 SD。
AI can make junior professionals look much better at the work without making them better at the underlying judgment.
That is the uncomfortable result from this three-month randomized trial with 133 patent lawyers across 11 U.S. IP firms. AI-assisted lawyers produced better patent drafts at both 10 and 90 days, and juniors got the largest gains: +0.58 SD and +0.60 SD respectively.
At 90 days, juniors gained 0.60 SD on AI-assisted drafting, while seniors gained 0.30 SD.
Then the researchers removed AI and tested a judgment-heavy redlining task.
The pattern reversed: seniors who had used AI scored 0.45 SD higher than senior controls, while juniors showed essentially no average gain at -0.03 SD.
来源:@rohanpaul_ai · x.com