Top
Best
New

Posted by krackers 14 hours ago

Xiaomi Mimo 2.6 live post-training dashboard(mimo.xiaomi.com)
424 points | 109 commentspage 2
thehamkercat 13 hours ago|
This is crazy, but sadly anthropic/openai will never do this, what has happened to this world, where chinese companies are more open than US or even EU companies
b3lvedere 1 hour ago||
Is that a bad thing?
medlazik 13 hours ago||
Neoliberalism, that famously open and transparent economic ideology
atemerev 5 hours ago||
Ah, one Donald Trump, a famous neoliberal.
stymaar 1 hour ago||
Were Sam Altman and Dario Amodei different men before Trump was in charge?
speedgoose 13 hours ago||
I didn't know 2 thirds of the training data would be source code.
jerrygenser 13 hours ago||
that is the the "data used to improve the model" when signing up for the subscription plans
leothetechguy 13 hours ago||
this is the rl run, not the pretraining run
ahmadyan 12 hours ago||
even in pre-training, usually 30%-50% is code these days.
leothetechguy 1 hour ago||
That would be far too high in my opinion. But happy if anybody can give insights from their own experience with pretraining runs.
kkotak 6 hours ago||
Wouldn't us observing this break down the model superposition and make it dumber? :)
brcmthrowaway 6 hours ago|
Found the Dark Matter (2024) watcher
rao-v 8 hours ago||
I absolutely love that someone is doing this! Why isn’t IBM for Granite or Google for Gemini?

If you are going to develop a near frontier model, and you don’t think you have special sauce up your sleeve, why not making training runs and RL environment scores etc. visible to the world?

I’m genuinely learning quite a bit just from the dashboard

gtirloni 7 hours ago|
They think they have the special sauce. Even if they do, what would they get in return for doing that?
jstummbillig 4 hours ago||
Wow, spending money on training an almost-frontier-model is much more time intensive than I thought it was.
monneyboi 1 hour ago||
Refreshing, now let's make this a default feature. I imagine a "Upcoming models" list with links to these kind of dashboards.
rozab 13 hours ago||
Why are they doing this? To try head off accusations about distillation?
bayindirh 13 hours ago||
Sometimes you're confident about what you're doing and show how you work to the world.

Keeping the garage door open, or at least making the door translucent. It's always cool.

jampekka 13 hours ago|||
That China's official policy is now to prefer open models and open model development may be a part of it.
culi 12 hours ago|||
BRICS just had a New Delhi meeting where Xi pushed a 5-point plan on AI cooperation that centered on open source models
Aboutplants 12 hours ago|||
With that policy in place, labs might be incentivized to be creative in their openness. This being fun/free PR
anemic 12 hours ago||
Bottom of the page says "Open is what we value."
wolttam 13 hours ago||
Hah, it would be great to see more labs pick this up.
ernsheong 11 hours ago||
Mino 2.5 has been my workhorse for coder and tester agents (the ones planner agents delegate tasks to)
wg0 3 hours ago|
"Slow down this much openness in AI or we won't get our trillion dollars valuations!"

Google had this GPT long go and a wise man within Google noted:

"We don't have any maot neither does anyone else."

The AI bubble burst is guaranteed and is only delayed by IPOs.

user43928 1 hour ago||
Nothing is guaranteed.

Open models have not yet caught up with February's Mythos checkpoint.

Meanwhile OpenAI is solving millennium problems, and their compute is still fully utilized.

wg0 28 minutes ago||
"Stealing millennium problems" would be more complete if not accurate description. And that 99.99% of the market is not interested in solving millennium problems is the other fact.
b3lvedere 1 hour ago||
I wonder what we will do with the discarded data centers and its hardware..
More comments...