Top
Best
New

Posted by shioyama 11 hours ago

Frostbite: A new CPU architecture discovered, designed and verified by AI(architectlabs.com)
564 points | 298 commentspage 4
api 8 hours ago|
AI is already superhuman. I have seen this coding.

The big superhuman areas are speed, motivation (infinite), context size, and associative memory.

We are in the “singularity,” which will be a sigmoid, but we don’t know where it will reach its next level.

What does it not seem to have? True volition. Creativity too, maybe, depending on how you define that, which is a can of worms.

a3w 7 hours ago||
It is also subhuman. In things like telling a joke.

A calculator is superhuman. In speed of calculating numbers. Then again, Wikipedia lists calculators as AI, for just that reason.

api 7 hours ago||
That's kind of what I mean.

I don't personally believe that intelligence is one dimensional, to the point of doubting that "general intelligence" exists or is even a valid concept. It's like saying "general locomotion." There is no such thing. There are wings for flying through air, fins and rotors for water, legs and wheels for land, rockets for space. A wheel doesn't work well in the air or space and a rocket is a poor locomotion method in the water.

This implies, BTW, that I don't think humans have general intelligence, because I doubt the existence of such a thing categorically. We get all up in our egos thinking we do because we feel so smart at all the things we're smart about, and of course we can't see the other things because we can't see them. Might not even be able to imagine them.

A chess algorithm is superhuman at playing chess. A human beats AI at writing prose or telling a joke. AI can beat a human at bug-hunting in a giant code base or constructing a large mathematical proof. Humans can beat an AI at dreaming up entirely new directions for mathematics. AI can beat humans at taking those new directions and fleshing them out and relating them to current art.

And so on.

We in fact tend to build machines to be hyper-good at things we are not good at, because that makes them useful to us. So we make AI that is better than us at fast thinking, huge context windows, huge scale associative memory, etc., just like we made classical algorithmic computers that were hyper-good at doing math.

muellero 5 hours ago||
I'm always amazed by this perspective. Despite the fact that a single principle component falls out of all analysis of abstract human tasks across individuals, there is a large contingent of people that still "doubt the existence of such a thing categorically".

There has been an open question in psychology for almost 100 years now: can you design a solvable abstract task for human performance that isn't correlated with this principal component? No one seems to be able to do it, and the AI models have only reinforced this. Making AI models smarter makes them better at almost EVERYTHING. The scaling properties of LLM models, and the scaling properties of neurons in the brain, ensure a general improvement of pattern matching that seems to be task invariant.

Personally, I am convinced by the speed hypothesis here. Since IQ in humans is very correlated with thinking speed, the ability to generate and evaluate more hypotheses per unit of time yields general improvement.

ianm218 7 hours ago||
Why do you think the singularity would be a sigmoid? Isn’t it by definition increasing rate of change and improvements continuously
scotty79 7 hours ago||
There are no true singularities in the real world. Only in math. We colloquialy call a singularity, a spot where things go out of normal very fast.
enricozb 10 hours ago||
In my opinion, the benchmarks chosen look small (e.g. json parsing with 4096 chars, mergesort with 1024 elements, fib(20)).
sylware 10 hours ago||
Is the core RISC-V ISA not too alien to this µarchitecture?
cupofjoakim 7 hours ago||
The scepticism among the comments is likely warranted - but i for one really think this area needs more research. x86, ARM and RISC-V are for sure "good enough", but surely those won't be the "final" design of cpu architecture.
joe-esquibel 6 hours ago|
We know from brain imaging studies where evolution has had billions of years to perfect design for function, that different brain areas have different wiring types. This suggests that similar pattern for silicon based computation devices where multiple architectures might be optimal for different problems.

Also, this is an early stage technology that might be promising and it should probably be compared against x86, ARM, and RISC-V in their early stages. I feel like we are comparing a young up-start against established legends.

zzzeek 7 hours ago||
> We believe AI fundamentally changes these economics. In the search for higher performance and lower power, extreme co-design of workloads, ISA, and hardware will continue to be demanded.

yeah this is why the "AI datacenter" debate frustrates me. People take it at face value that the enormous power demands of AI are immutable - they're thinking in a 20th century way where we're powering like, air conditioners or something that aren't changing. It's not at all a given that AI is going to demand power in a year or two the way it does now, these are problems that should be solved, not used as a reason to abandon the whole technology.

odo1242 1 hour ago|
Jevon's paradox though: any efficiency increase in AI is likely to just result in more AI, not less overall energy use
CMay 7 hours ago||
I want this to be interesting, but instinct says despite the investment and namedropping on their about page, this is nothing until they show something. The language is vague in the wrong ways. It's either truly great, or they're afraid it sucks, or they need to waffle for some competitive reasons that aren't clear to a reader. It doesn't seem like there's enough fundamental information here to care.

Is it that they don't want to overstate their claims to investors who have to decide whether to actually build these, in case the results they're predicting don't add up?

Either way, we need to be working on EDAI, so if they've got something, hopefully it's something.

sigbottle 6 hours ago||
Yo what the heck. That's kind of funny, the only other guy I know working on this were the HVM guys. They were validated I guess?
moron4hire 2 hours ago||
Am I the only one who gets really bothered by the use of "by AI" instead of "with AI," in these kinds of statements? Like, the LLM didn't just decide "oh, this looks like a neat thing to work on" all by itself.
ytxm 10 hours ago||
Absolutely breathtaking number of claims, and impossible to find the seam between human endeavour and spambot output. Would love a sober overview of this from a suitably competent human, history is littered with promising sounding architectural approaches (anyone remember the Mill?) that went nowhere.
mawadev 8 hours ago||
I'm always on the fence and I only believe it when I see such a CPU manufactured and running crysis with better metrics (energy, performance, thermals, stability) than a regular off the shelf cpu as we know it. It needs some sort of proof an average Joe, like me, can see and understand. Until then its just theory to me.
xyzsparetimexyz 10 hours ago||
One of the worst things about the llm era is that it's very hard to tell the difference between ai-written breakthroughs and ai-written schizoposts.
sph 10 hours ago|||
i.e. signal-to-noise ratio has lowered dramatically and news platforms such as this cannot cope, unless they basically turn into clickbait and hype factories.

We used to say ‘show me the code’, we need a bit more proof today. Or just wait it out to see if the authors are still pursuing the same idea 3 months later or have they already moved on.

xyzsparetimexyz 9 hours ago||
Yeah that makes sense to me honestly. Hard to tell at a glance if a fable oneshot is being dumped out, or if the creator has actual skin in the game
sensanaty 7 hours ago|||
Well that's easy, the vast majority of AI slop is a schizopost basically by definition!
Iolaum 9 hours ago|
Before even reading anything the word discovered on the title triggered me. It's was not there waiting for someone to find it - like electrostatic attraction/repulsion. It was either designed or "statistically and agentically arrived at it" if my high level mediocre knowledge about how people use AI to research those things is even a little relevant.
jkhdigital 7 hours ago|
It’s more like it took some really clever insights sprinkled throughout a few decades of hardware/compiler/PL research and did all of the engineering and design work to turn those brilliant (human generated) ideas into a formally specified standard.
More comments...