Posted by JohnBerryman 3 hours ago
I'm not following. There are way more tools in the world, and likely available on every machine, than can fit in any model context. One can create a small list, but that will be very org dependent. Programming is very open ended, I struggle to see the 'deterministic set of choices' here.
I'm looking at Jev/Kev like models for some control over tool calling and similar, but I also think that fine-tuning out behaviors (like qwen 3.8 wanting to use rkt all the time) may be better in the long run. Instead of having to check/change every tool call, we can refine the main LLM to have high enough likelihood of using the tools we actually have, that we won't need to check every call.
Jev is definitely useful, but also being held like a hammer in search of a nail right now, approaching OpenClaw like fanfare and hype levels. No one talks much about OpenClaw these days, I would not be surprised if Jev has a similar trajectory.
I think demand for tools that are more tailored for this type of integration is high. I don't really understand why Jev is supposed to get my company's decisions right more than an LLM, but regardless of the tech I think people are just excited about the possibility of iterating faster, more explainability, higher-level tools that are specifically created to help hone classifiers etc.
Fed Claude an api key from typesafe and a link to documentation, and within about 10 minutes I had a view of HN that was populated with a little ranking as to sloppiness of each comment.
When your mind has been wired a bit to LLM latency, it feels extremely fast, and for such a subjective rating I think it did a good job.
Feels like it sits in a space between traditional ML classification and the frontier models. I can't think of a 'real' production use case for it in my sphere of influence, but certainly some will. And of course there will be five Jev competitors by the end of the year.
Open weight classifiers and open weight LLMs will be burned onto silicon cards in a few years after the models begin to stabilize. They'll be in PCs and laptops. That's going to capture a HUGE chunk of the market.
If you need more horsepower, you'll rent the same silicon safely from AI services cloud providers without handing your data over to Anthropic and OpenAI.
As there have been a lot of Jev related submissions, can someone point me to a simple guide on how I can use it? For example, say I have a script/workflow where I use OpenRouter for LLM calls, and at some point I want to do a simple classification. Can I still use OpenRouter with some Jev model...?
I love this!!
vLLM has a PR very close to merging: https://github.com/vllm-project/vllm/pull/57250
Kev is an open Jev: https://github.com/jaredpalmer/kev