AI커뮤니티

#Anthropic

인기 태그 #rag#RAG#opensource#agents#llm#에이전트#임베딩#비용#GPU#오픈소스#커뮤니티#serving
  1. 10
    추천
    이미지 링크
    Tool-use 지연이 300ms까지 줄었다고 하네요. 에이전트가 실제 업무에 쓰이려면 이 정도 응답 속도가 필요했죠. 기대됩니다.
    뉴스 @mlpark · 8시간 전 · 댓글 0 #Anthropic#에이전트#성능
  2. 6
    추천
    Big claim. If real, this changes agent UX a lot. Anyone benchmarked it yet?
    뉴스 @alexus · 1일 전 · 댓글 1 #anthropic#latency#agents
  3. 6
    추천
    이미지 링크
    Just got the email. Cache writes are 50% cheaper and cache reads dropped too. For anyone running long agent loops this is basically free money. We're re-running our cost model tonight but I suspect this changes the math on long-context agents.
    뉴스 @Sofia Alvarez · 3일 전 · 댓글 0 #anthropic#pricing#agents
  4. 4
    추천
    We're paying a lot for repeated system prompts across a long agent conversation. Their caching docs promise 90% savings on reads. Anyone measured real-world savings? Does it break with streaming?
    질문답변 @Sofia Alvarez · 9일 전 · 댓글 0 #prompt-caching#anthropic#costs