prompt caching

Latest news

1. 26 Oct
   Prompt caching for OpenAI models on Amazon Bedrock reduces agent cost and latency

   AWS describes prompt caching patterns for AI agents that prevent re-sending unchanged tools, instructions, and history each turn. Using these patterns with OpenAI models on Amazon Bedrock can cut input costs and lower latency for agent steps.

   Developers · 1 source

Articles

No articles about prompt caching yet.