跳到正文
@Yuchenj_UW· @Yuchenj_UW · X·· 15 天前AI 评分25
AI 导读

别误会,编程/工程远未被解决。 天花板依然很高。但如今的 LLM 会在复杂系统上卡住,比如构建一个可扩展的推理系统,能在 neoclouds 之间安全地服务 1B tokens/sec。 这不是一个提示词就能搞定的。

正文

Don’t get me wrong, coding/engineering is far from solved.

The ceiling is still very high. But LLMs today get stuck on complex systems, like building a scalable inference system that can securely serve 1B tokens/sec across neoclouds.

You can’t build that with one prompt.

来源:@Yuchenj_UW · x.com