Find answers from the community

Updated 2 months ago

What does cache control type ephemeral do

what exactly does the "cache_control": {"type": "ephemeral"} do?
S
2 comments
If supported, it will do prompt caching
If you're not using Anthropic I believe it will be ignored
Add a reply
Sign up and join the conversation on Discord