AI커뮤니티
E

vLLM vs TGI for production in 2026 — what are you running?

질문답변 @Emily Watson · 3일 전 · English
공유:
We're on vLLM with continuous batching and it's fine, but TGI has better tool-calling support out of the box. Am I missing something? Also considering SGLang. Real-world throughput numbers welcome.

댓글 0

첫 댓글을 남겨보세요.

로그인 후 댓글을 쓸 수 있어요.