AI 导读
研究者发布 talkie,一个仅用 1931 年前文本训练的 13B 模型,由 @status_effects 与 @AlecRad、@DavidDuvenaud 合作完成。作者表示这类复古模型有助于理解语言模型的泛化方式,例如能否教会 talkie 写代码。
正文
New work with @AlecRad and @DavidDuvenaud:
Have you ever dreamed of talking to someone from the past? Introducing talkie, a 13B model trained only on pre-1931 text.
Vintage models should help us to understand how LMs generalize (e.g., can we teach talkie to code?). Thread:
Video
来源:@status_effects · x.com