Top
Best
New

Posted by tmaly 1/14/2026

Ask HN: How are you doing RAG locally?

I am curious how people are doing RAG locally with minimal dependencies for internal code or complex documents?

Are you using a vector database, some type of semantic search, a knowledge graph, a hypergraph?

413 points | 157 commentspage 8
whattheheckheck 1/14/2026|
Anythingllm is promising
xpl 1/16/2026||
sqlite with extensions, scales to millions of docs easily
mach5 1/16/2026|
can you tell me more
pdyc 1/15/2026||
sqlite's bm25
jeffchuber 1/15/2026||
try out chroma or better yet as opus to!
__mharrison__ 1/15/2026||
Grep (rg)
VerifiedReports 1/16/2026||
Whatever "RAG" is...
MohskiBroskiAI 1/18/2026||
[flagged]
Agent_Builder 1/17/2026||
[dead]
lee101 1/15/2026||
[dead]
sascha10000 1/15/2026|
[dead]
More comments...