AI 导读
OpenAI Developers 介绍面向应用的缓存调优能力,可通过显式缓存断点选择要复用的提示词前缀。该能力还允许在保留缓存上下文的同时调整推理强度和工具可用性,并支持预热共享上下文以让响应更快开始。
正文
Tune caching for your application:
– Choose which prompt prefixes to reuse with explicit cache breakpoints.
– Adjust reasoning effort and tool availability while preserving cached context.
– Prewarm shared context so responses start sooner.
https://t.co/ILhdJ9uWcZ
来源:@OpenAIDevs · x.com