H
Hacker News
Top
Best
New
Posted by Maverick617 1 hour ago
Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia
(github.com)
19 points
|
2 comments
PcChip 36 minutes ago
[-]
I didn't see any benchmarks against vllm, sglang, exllama, etc
rancor 28 minutes ago
|
parent
[-]
Since this is basically a wrapper around libllama.so, I would assume that the performance is roughly the same as llama.cpp upstream.