Posted by kuberwastaken 19 hours ago
What does that mean?
hybrid instruct-and-reasoning MoE: The model includes a subsystem that can run portions of the model at a time and assign itself tasks, greatly improving the capabilities over running the model in the original fancy-autocomplete method early LLMs used, and letting the model run on simpler hardware.
with multimodal input: The model can parse images, video, and audio, as well as text, so the user can upload files of those types and run a prompt that analyzes them.
Mistral has "Mistral Vibe CLI" that is similar to Codex / Claude Code -- and it is supposed to have some small quota to allow free usage.
I tested it a few months ago and it seems okay -- no where close to SOTA but still a fall back for very simple tasks. I tried it again this week and it times out and says requests are rate limited even when we start with just a "hi".
Anyone knows if this is still an active project or abandoned.
[*] I'm likely "holding it wrong" as I've as of yet failed to experience the "nowhere close to SOTA" claim. I'm not sure I can tell the output of so-called SOTA (Claude, at work) apart from Mistral's, but different people probably use things in different ways with different prompts, or maybe I fill in any blanks mentally somehow, no idea.
Edit: trying to output single asterix for the note
I pick a model on performance for the job, and from what I've seen, this isn't it.
The price cut makes it more interesting than the preview was, tho.
In other words, I don't think there's anything misleading happening in the title. When most people discover that certain restrictions exist on using the weights, they will neither be surprised nor disappointed, because the main thing that's being advertised - the weights are available for download - is true!
Open source or source available is something else entirely. To consider something source available I would require the actual training data to be available too. That is exceedingly rare.
If it only restricted resale that would be okay in my book to call open weight. But this license is stifling.
"Weights available" does not seem to be in wide use and doesn't, to me, communicate anything different than "open weights."
"Source available" is definitely in much wider use than "weights available" but it's not that common and it's not used consistently at all in my experience.
Weights are different enough from source code I don't find the metaphor useful or compelling. I don't see any value in trying to apply it to a novel subdomain of software engineering, frankly.
Anybody calling SQLite "source available" is mistaken. Are you sure they weren't confusing "source available" with "open core" (Open Source + proprietary add-ons)? SQLite's source code is public domain, which meets the Open Source Definition and is true Open Source. But they also sell proprietary add-ons to fund its development:
No one calls SQLite "source available", and if they do, they're doing it more as a protest of their development model than being serious.
https://gitlab.com/gitlab-org/gitlab/-/blob/master/ee/LICENS...
You shouldn't. The term existed in the community before they tried to prescriptively define it. They have no authority over the term.
That's the neat thing. Nobody is. It is a multi-consensus arrangement where you have different parties that accept different definitions.
>in which case you have to somehow demonstrate that's the way people understand it?
Why?
This is a common mistake a lot of people make. "I think X = 1, therefore everyone that is correct thinks X = 1". There could be huge variation in subgroup understanding on what this should be, and as long as there is no overarching legal requirement then you could consider them all correct on matters of opinion.
It's annoying that people pretend like Open Source was a common phrase before it was invented to subvert Free Software by OSI, and it's shameful that people would tell this lie for the sole purpose of trading on the goodwill that Open Source software has created. Even in the world where people were always talking about "open source" before the OSI, that talk is certainly not the reason that people who are using the term to describe non-OSI approved licenses are using it today. They're intentionally trying to defraud people, and have the nerve to be snotty about it.
If you think about it the actual mapping is more like:
- closed weights -> closed-source web service (e.g. gmail)
- open weights -> closed-source but you get the binaries (e.g. Minecraft)
- Actually open model (with training data, training pipeline etc.) -> open source
I think this is really splitting hairs, they just want to give people the ability to self-host (which is awesome) yet still make money off it for cloud based hosting.
But then again, I also always understood that startups want to prevent AWS from capitalizing on their source code as well and sympathize with Elastic, MongoDB, etc so perhaps I’m an outlier here.
Businesses should be able to release things to the public yet still be able to control who makes money off of it.
No. In the context of software licensing, "open" vs. "free" is more a question of philosophy than any practical difference. The Free Software Definition and the Open Source Definition agree so closely that I can't think of any license that meets one but not the other. But the Free Software Foundation sees freedom as an end in itself, even if it requires sacrificing quality, while the Open Source Initiative sees freedom as a tool to be used to improve software quality.
> Businesses should be able to release things to the public yet still be able to control who makes money off of it.
Nobody's stopping them. People are complaining about the lying. They can do whatever they want with their IP.
Many industries had "source available" without the word "open" for decades, and that was a broadly understood term. "Weights available" would be a reasonable analogue.
For clarity, the Mistral model license is here: https://huggingface.co/mistralai/Mistral-Large-4-1T-A52B/raw...
> 2. If the Licensee or any of its affiliates operates a Model as a Service business, the Licensee must enter into a separate commercial license with Mistral before using the Model or its derivative works for any commercial purpose. The Licensee may contact Mistral, using this form: https://mistral.ai/contact/, to request a commercial license.
> "Model as a Service" means giving a third party access to the Model or its derivative works for inference or post-training by any means (for instance via API or hosted endpoints), in a manner that allows such third party to exercise meaningful control over the inputs, parameters, or training data. This does not include (a) end-user products with model capabilities solely embedded within specific features or harnesses, or (b) mere relaying of requests to models hosted by others.
"Meaningful control over the inputs" is so ambiguous as to be nearly meaningless. Does a model merely summarizing a user's submitted support tickets, give that user meaningful control over the inputs?
Don't get me wrong - I appreciate that Mistral needs to walk a fine line for its own sustainability, and that sustainability is a good thing! And I may just be an old person ranting at a cloud. But "open" used to mean something, back in my day!
Weight-available is a better adjective for this kind of licensing. Same for Qwen, GLM, Kimi, MiniMax, etc. If they really want to be open source, they should pick an OSI-approved license.
Works for me. I can host it, I can run it, I can use it; but if I want to sell access to it as an inference provider, I'd have to get a license.
The economics of open-weight models has always been shaky. It's not an OSI license yes, but metaphorically it's kinda like AGPL.
https://huggingface.co/mistralai/Mistral-Large-4-1T-A52B/raw...
Very much not open as in open source. It's a shame an organization such as OSI doesn't get out ahead of licensing of weights, what do we call this? "Weights Available" ?
If someone sends me a copy while fully adhering to the license, what right does someone have to tell me what I can do with it? If I buy a book do I not have a right to read it? Lend it to people?
It's probably a good thing libraries already existed pre modern copyright.
Do you mean Chinese hosted models?
Because if you're avoiding anything from China, you're going to be sitting in a shack on the side of the road.
Can always replace the backup copy with a better one on next release.
Or is someone running an initiative like this, such as Archive.org folks?