AI 导读
@vllm_project 借助这些及其他优化，vLLM 团队将 Kimi 推理提升到新高度，在 2 周内将高并发吞吐量提升超过 6 倍。(4/5) https://t.co/BKTTjalmOy
正文
@vllm_project With these and other optimizations, the team at vLLM brought Kimi inference to new heights, increasing high-concurrency throughput by more than 6x in 2 weeks. (4/5) https://t.co/BKTTjalmOy
来源：@SemiAnalysis_ · x.com