MIT 报告明确建议不要依赖 AI 检测器，认为其概念上不成立：真实学生作业中不存在可验证的独立基准，检测器准确率无法判断某一次标记是否正确。报告指出，学生可用"AI humanizer"规避检测，误报会伤害学生，非英语母语者和神经多样性学生的写作也易被误判。论文还给出一个假想案例：某检测器零误报，却放过了 27 篇论文中 11 篇完全由 AI 生成的论文。
If you need more proof that AI detectors fails in education, this paper makes the case so simple and clear.
These "AI detectors" tools are conceptually unsound because, in real student work, there is no independent ground truth to verify whether a flag was actually correct.
Even a detector with a perfect record on false positives would still fail, because the students it misses are the ones skilled enough to disguise their output. What ends up being punished is not AI use but clumsiness at hiding it.
A detector's accuracy rate tells you nothing about whether any particular flag it raises is correct.
Turning that rate into a probability about any one flagged case needs the base rate, which is unknowable.
So a classifier deployed where ground truth is never observable cannot settle an individual case, only justify a closer look.
Detectors measure something real on labelled corpora, but this paper argues the measurement cannot travel into settings where nothing confirms authorship.
Even a detector with no false positives does not fix this: in the paper's hypothetical, such a tool cleared 27 papers of which 11 were entirely AI-generated.
The AI detector industry should be very uncomfortable reading this MIT report. The strongest institutional rejections yet, direct from MIT. "we recommend against relying on AI detectors. " "As it risks an arms race in which students respond to automated detection by using increasingly powerful “AI humanizers” to remove signals that AI detectors are cued to catch. The result: a lot of effort on both sides that in the end serves no one." The report argues that mixed human/AI writing is difficult to detect, detectors can be evaded by “AI humanizers,” false positives can harm students, and heavy policing creates distrust. AI detection systems may also mistake the writing of non-native English speakers or neurodivergent students for text generated by AI. Even low rates of false positives can put students on edge and cause serious individual consequences."在 X 查看被引用的帖子
来源：@rohanpaul_ai · x.com