AI 导读
Kim 与英伟达的 Shruti Koparkar 讨论 AI 基础设施的经济学与软件，她表示会优先测试每瓦性能。对话还涉及 CUDA 与 CUDA-X 的实际作用，以及 Pinterest 如何用同一批 GPU 同时跑推荐系统、语言模型和视觉语言模型。双方还谈到新模型发布后，旧 GPU 何时保留、改造或替换。
正文
How much useful work can an AI factory get out of the power it has?
I sat down with @nvidia 's Shruti Koparkar to talk about the economics and software behind AI infrastructure.
We discuss why she would test performance per watt first, what CUDA and CUDA-X actually do, and how Pinterest has used the same GPU fleet for recommendation systems, language models and vision-language models.
We also get into what happens when a new AI model launches, and when it makes sense to keep, repurpose or replace older GPUs.
YouTube down below:
来源：Chubby♨️ · x.com