S
Anthropic prompt caching — worth the setup for a chatbot?
We're paying a lot for repeated system prompts across a long agent conversation. Their caching docs promise 90% savings on reads. Anyone measured real-world savings? Does it break with streaming?
댓글 0
첫 댓글을 남겨보세요.
로그인 후 댓글을 쓸 수 있어요.