Top
Best
New

Posted by Ardakilic 4 hours ago

Ollaya – Ollama for open-source, Jev-style decision models(ollaya.dev)
215 points | 67 commentspage 2
oguzhankayan 1 hour ago|
Nice work! Making open models easier to run locally is valuable on its own. Keeping the API compatible with Jev is a thoughtful touch, too.
handfuloflight 3 hours ago||
Sounds good on latency but how is its actual decision quality vs. Jev?
cobanov 3 hours ago|
Depends on the model. The small ones I support today are well below Jev on harder queries, but fine for simple, well-defined questions. The open models that get close to Jev are bigger, and I'm adding support for those next.
datadrivenangel 4 hours ago||
Are there many models that are comparable to Jev for generic decision making?

Smarter move if you have an eval set is to just train a classifier and call it a day.

rgbrgb 4 hours ago||
there's this thing with a bunch of similar models https://huggingface.co/spaces/multimodalart/jev-decision-ind...

top open one is trained by perplexity cto for $3k, kinda cool https://x.com/denisyarats/status/2102252088067850507

physicallyIllfr 3 hours ago||
<<<"i was curious to see if i could train a competitive Jev-like model completely autonomously with a swarm of agents using our internal system."

Bro is writing off the H200 lol

On a sidenote I really can't stand the term "swarm" and definately plays into AI doomerism.

lirolero 3 hours ago||
[dead]
cobanov 3 hours ago||
The link rgbrgb posted is a good overview. The best open ones are close to Jev now, but they're big models. And I agree, if you have an eval set for a fixed task, a trained classifier is the better choice.
emmettbt 4 hours ago||
Cool... but this does seem undermined by the fact that Ollama can add support for decision models at any time.
cobanov 3 hours ago||
Fair, and I'd be happy if they did. Ollaya uses the same API as Jev, so your code isn't tied to it either way
accountrequired 3 hours ago||
and that ollama is go-llama and not rust, so it's not really the ollama of anything
vorticalbox 2 hours ago||
Does anyone know what laya multi lang is faster than laya en? I would have thought focusing on a single language would be faster.
gauravsapkotanp 3 hours ago||
I have also tried this and its really awesome
george_max 3 hours ago||
I am fairly confident if Jev-style decision models are seen as prominent (which, they seem to be), Ollama will support them. Surprised the team hasn't implemented this already.
eserozvataf 3 hours ago||
great project for empowering open-source alternatives.
rkovashikawa 3 hours ago||
open-source is the only way for safe AI development. whoever doesn’t share the weights/code will lag behind.
cobanov 3 hours ago||
Thanks!
imnotr0b0t 2 hours ago||
[dead]
adityamwagh 2 hours ago|
Hey Claude, make ollama for Jev like models. Make no mistakes /s
verdverm 2 hours ago|
hey Claude, download and run vllm nightly for me

(already merged)

GoModel (gateway) already supports Jev like endpoints too

https://gomodel.enterpilot.io/docs/providers/jev

More comments...