Posted by bastitx 13 hours ago
additional paper: https://tej.as/blog/aleph-alpha-kolibri
This thing is worse than a Qwen3.8 27B.
I think it's not simple to directly compare a 27B dense model with an MoE model like ours. As we know, dense models need all params active for every token. Whereas, MoE models (especially sparse ones like Kolibri) fewer active parameters and correspondingly less compute per token.
Among the MoE models we compared against in our tech report and model card, though, Kolibri performs very well in our evaluation, including against models with 12B active parameters. It also best model in the group we tested within that range of active params.
So, I think it's fairer to see this as a trade-off. Kolibri needs less compute per token but more memory, while Qwen3.8 27B needs far less memory and more compute per token. In the report, both are actually on the quality-vs-serving-cost Pareto frontier among the models we evaluated, just at different points.
Sovereign works when talking about building a commodity supply or something, not in literally the world’s most competitive and fast moving field.
Those seeking sovereign capability would be better off aiming to be best at something, even something much narrower than an all round LLM. Or just fast following and making something that matches leading performance, which is close to what the Chinese labs do currently.
More specifically, I asked the model about what I should put on my contact page, which can cost you in the order of 500 € in Germany if you don't write the right magic words.
Kolibri incorrectly referenced the "Telemediengesetz" ("telecommunication act"), which has been superseded by the "Digitale-Dienste-Gesetz" (DDG, "digital services act") since 2024. The model knows about the DDG, but does not reference it unless specifically instructed to do so.
If anyone of the developers reads this, you can fix this by introducing a recency bias during training. You can even control it by conditioning the model on a date provided with the system prompt or first prompt, so you can travel in time.
Good to see Europe adding toe what Mistral is doing. +100
We have a separate repo for BF16: Kolibri-1-BF16. Will still be tough to put it on a Mac though :(
Disclaimer: I'm part of the team that trained Kolirbi
Model Training as Code - https://news.ycombinator.com/item?id=48673450 - June 2026 (24 comments)
> built for sovereign mission-critical work in regulated areas including public administration, industrials and aerospace
Cool to be doing more independent model lineages, but I sure hope no one actually uses this as part of any aerospace engineering...
I’ll be curious to see which it becomes in the next year - nba “very narrow record”, or a sign you can hang with the big boys.