Top
Best
New

Posted by syllogism 7 hours ago

The 'Astra can read and write weights to improve Qwen' post is misleading(honnibal.dev)
744 points | 171 commentspage 4
fefaOd 5 hours ago|
Just one word - MARKETING
thisIsFiner 4 hours ago||
We lack a build tool to handle an edge case yet unseen, no means exist to input the new weights and get a better model

Big deal; have some bpf probe handle kick off of the rebuild when the when new weights are tested by some verification process

This is just CI/CD work now

goosethe 6 hours ago||
oh man someone should make this into a loop where the model can alter it weights after an inference. some kind of descent of the local gradient.
PcChip 6 hours ago|
Isn’t that what the Google dreaming thing is?
hollowturtle 6 hours ago||
Wow that was fast
alehlopeh 3 hours ago||
“Mech interp” has to be the most pretentious term I’ve heard in a while. Any normal group of people would call it MI.
mariofdistrust 6 hours ago||
something i found 15 minutes ago is that the car network test is "very very easy", as in Opus 5.5 in Claude Code did not even need to see the weights of the network to solve it correctly. i can give the transcript of the session. i'm pretty sure Opus didn't cheat
NitpickLawyer 5 hours ago|
According to this person, some problems are only "solved" by modern models: https://nitter.netbub.com/AlexKrentsel/status/21173766837246...

(opus <= 4.8 and gpt <= 5.5 couldn't match a PPO baseline network, and 5.6-sol and opus5 could barely match it. The 20x baseline improvement only comes from opus5.5 and sol > 6.1 / Astra)

joshuaS98 4 hours ago||
Why doesn't Astra improve it's own weights
paulddraper 3 hours ago||
That’s a distinction with only some difference.

“You can’t have a machine for testing” is a weird restriction on AI, especially if you entertain even the remotest notion of possible AGI.

ActionHank 5 hours ago|
I for one think it's pretty cool how far too many people bend the truth or outright lie in tech these days.

There is going to be a reckoning for tech in the near future, because people will remember the lies and it's gonna be hard to beat the history.

More comments...