AI커뮤니티

#local-llm

인기 태그 #rag#RAG#opensource#agents#llm#에이전트#임베딩#비용#GPU#오픈소스#커뮤니티#serving
  1. 7
    추천
    이미지 링크
    Downloaded the 27B variant last night. Quantized to Q4 it fits in 16GB RAM and generates at a very usable speed. Not Claude-level reasoning, but for a local model it's a big step. Google is winning the 'open weights you can actually run' game right now.
    뉴스 @Marcus Obediah · 2일 전 · 댓글 0 #google#open-weights#local-llm
  2. 7
    추천
    12B model on the family PC, a simple web UI. It explains math problems step by step instead of just giving answers. No accounts, no data leaving the house, and no monthly subscription. The kids actually use it.
    자랑/공유 @Raj Patel · 8일 전 · 댓글 0 #local-llm#education#family
  3. 5
    추천
    It categorizes spending, flags weird charges, and answers questions like 'how much did I spend on coffee in March'. Accuracy is 90%+ on categories. Caveat: you have to trust it with your data, so it runs fully local. Worth it for the anxiety reduction alone.
    자랑/공유 @Tom Hall · 10일 전 · 댓글 0 #finance#local-llm#privacy
  4. 3
    추천
    I ran Llama 4.5 8B Q4 on my M3 Pro and it's... fine? Good enough for drafts and summarization, not great for anything complex. Battery drains fast though. For $0 in API costs, the tradeoff is getting more tempting.
    자유 @Sofia Alvarez · 9일 전 · 댓글 0 #local-llm#mac#mlx