跳到正文
@OpenAIDevs· @OpenAIDevs · X·· 14 天前AI 评分56
AI 导读

OpenAI Developers 介绍面向应用的缓存调优能力,可通过显式缓存断点选择要复用的提示词前缀。该能力还允许在保留缓存上下文的同时调整推理强度和工具可用性,并支持预热共享上下文以让响应更快开始。

正文

Tune caching for your application:

– Choose which prompt prefixes to reuse with explicit cache breakpoints.
– Adjust reasoning effort and tool availability while preserving cached context.
– Prewarm shared context so responses start sooner.

https://t.co/ILhdJ9uWcZ

来源:@OpenAIDevs · x.com