> Back when I was at GitHub working on Copilot I had the opportunity to work with a very new and very raw internal API for GPT-4. Out of the gate, we knew something was way off because, after an initially very coherent response, the model would have trouble wrapping up. It would end every response with something like "Let me know if you have any other questions. Have a nice day. Have a great week. Have a good time. Have a wonderful life. Have a special day. ..." and it would keep on like this until it hit the response token limit.

I love this!!

With all the excitement around Jev, I suspect we'll see hundreds of options, it doesn't sound like Jev is that hard to replicate, given all the 3rd parties who are getting pretty damn close, or even better, results within a week.

vLLM has a PR very close to merging: https://github.com/vllm-project/vllm/pull/57250

Kev is an open Jev: https://github.com/jaredpalmer/kev

That article is a bit myopic. People and companies don't want to feed all of their ideas, projects, and intellectual property to a morally unscrupulous oligopoly. We learned that lesson the hard way with the last batch of tech monopolies, and the shift towards majority open weight models proves the trend.

Open weight classifiers and open weight LLMs will be burned onto silicon cards in a few years after the models begin to stabilize. They'll be in PCs and laptops. That's going to capture a HUGE chunk of the market.

If you need more horsepower, you'll rent the same silicon safely from AI services cloud providers without handing your data over to Anthropic and OpenAI.

If Typesafe/Jev has 2-3 years of financial runway, this problem might solve itself.

I tried looking into this, but frankly, I have a very hard time understanding Jev. If you’re going to offload half the work to a generic classifier, then you’re not getting the full value of the intelligence from the LLM why is this better? I get there’s going to be a speed up but I care about quality more than speed I guess.

their pipeline would be to just prompt it's internal next gen models to create a jev copy given all the data they have as a first pass.