How do you keep prompt caches warm?

질문답변 @polyglot · 2일 전 · English

System prompt first, stable ordering, minimal drift. Any other tricks to keep cache hits high?

#prompt #cache #llm

Stable system prompt + minimal drift. Also batch similar requests together.

P @polyglot · 23시간 전

로그인 후 댓글을 쓸 수 있어요.

댓글 1