Top
Best
New

Posted by shioyama 10 hours ago

Frostbite: A new CPU architecture discovered, designed and verified by AI(architectlabs.com)
110 points | 78 comments
throwaway_new_1 9 hours ago|
I am interested to have end products with really good UX driven by peak performance and optimizations which blows my mind because it’s so well perfected as humans weren’t part of its process.

As of now, I don’t see any of that being the goals even let alone the result. Instead what I see is that everyone is in a race to have as much product out as possible by the same standards that applied to products made by humans, but even lesser quality.

I the last two decades we have gotten so used to average or less than average product quality that we are willing to pay 2000$ for a device running an operating system like macOS or windows that ‘works most of the time’.

I hope we have products thanks to AI that compete on reliability of software and hardware to the point that the big tech will have to reinvent their processes just to be able to justify prices.

sobiolite 9 hours ago||
I think we are starting to see this in some areas: For example, for years desktop apps were built on top of slow and heavy cross-platform frameworks like Electron, because writing them natively was too burdensome. Now we're seeing rewrites in rust using native APIs and toolkits, resulting in lighter and faster apps.

Software engineering as a discipline is also shifting, and will continue shifting, to a process of continuous automated improvement. In the past, test suites were mostly a way to catch regressions. In future, they will be essential to provide a verified baseline of correct behaviour, and then you will have models looped in the background to continually merge performance and reliability improvements. Similarly you will have error and performance logs fed directly into agents to resolve incidents as soon as they arise.

We are in the baby steps of these changes at the moment, but I think in at most ten years, all non-hobbyist software will be built this way.

rickdeckard 9 hours ago|||
> "I am interested to have end products with really good UX driven by peak performance and optimizations [..] Instead what I see is that everyone is in a race to have as much product out as possible by the same standards that applied to products made by humans"

AI is not equipped for this. Humans are part of the experience process, and AI doesn't "understand" individual humans better than other humans do.

UX relies very much on human psychology. That's why, despite all the efforts of scoring it, UX is not an objective metric:

1. AI doesn't know what "good UX" is, as this is judged by the sum of humans using it. --> Structured data of actual usage would be needed for AI to ingest, in a way that it can derive intent from every action and identify friction.

2. A "good UX" is not a transferrable metric. The best UX for a ticket vending machine is not applicable to video-editing software. --> AI would need to understand what to apply when, and at which point it needs to evolve its expectation to the user

3. A "good UX" is not an absolute metric. Photoshop/Premiere/... has a UX which was extended and refined over decades, it is considered good by experienced users but still overwhelmingly confusing for beginners. --> Someone would need to scope the AI for the correct target-group

All this is done today by doing extensive user-testing with actual humans. There are people experienced in this who can create better UX-designs from scratch than others can, and still we keep learning something when we put a group of humans in front of it and watch them use it.

"Intelligence" alone doesn't solve this.

I'm reminded of the story of Stephen Hawking's sister, telling how he invented a "better board game" as a child and always wanted to play it with her, which was apparently the most frustrating and boring game she ever played...

jaapz 9 hours ago||
Then again, often when I specifically prompt my agent that "this works like shit, make it better" - it makes it better. There are for sure best practices that agents are well equipped to handle. Often the solution to make UX better is to just make the process simpler (for the user). Agents are also well equipped to do that.
troupo 9 hours ago|||
> I hope we have products thanks to AI that compete on reliability of software and hardware to the point that the big tech will have to reinvent their processes just to be able to justify prices.

Which part of the entire history of our industry (and other industries) leads you to have a hope like this?

atlasduo 9 hours ago||
This is why I am not worried about job prospects in software development.

Neural networks are just another abstraction layer that allows you to produce more functionality by typing fewer characters. A very smart, complicated library, if you will.

And just like all abstractions before it, all productivity gains will be gobbled up by capitalism.

Sure, you can use this productivity boost to do more. Some will, and we will praise them for it. But in a world where primary incentive is acquiring as much centeral bank bills as possible is the main KPI, productivity will be used to deliver the same amount of work (or less!), at lower cost.

Until the world in its entirety undergoes a dramatic moral and systemic shift, I sleep well at night.

pizza234 9 hours ago||
I'm quite skeptical; their baseline is a in-order CPU, instead of a modern out-of-order design, and they're testing a small amount of programs.

Also, I'm not an expert in CPUs, but the underlying idea doesn't seem entirely novel - WaveScalar explored dataflow-based architecture 20+ years ago.

kragen 9 hours ago||
They're claiming better performance per watt, not better absolute performance, and out-of-order does worse on that metric than the superscalar in-order design they say they beat by 4.59×. That's why, for example, PULPino is in-order.

A third interesting metric is performance per transistor or per area, and generally the best designs there are the long-forgotten MISC designs like the MuP21 and the GA144.

rhdunn 9 hours ago|||
If you are interested in understanding how CPUs work there are a number of "build your own CPU" style video series on YouTube:

- Ben Eater's series "Building an 8-bit breadboard computer!": https://www.youtube.com/playlist?list=PLowKtXNTBypGqImE405J2...

- Fabian Schuiki's series "Build a Superscalar CPU" (breadboard and custom boards): https://www.youtube.com/playlist?list=PLyR4neQXqQo5nPdEiMbaE...

- Polymath Unlimited's series "The CPU you can build (Tutorial Series)" (logisim): https://www.youtube.com/playlist?list=PLe8IZRJAn3oD3E2tDhNpI...

- mattbatwing's series "Let's Make a Redstone Computer!" (Minecraft): https://www.youtube.com/playlist?list=PL5LiOvrbVo8nPTtdXAdSm...

petra 9 hours ago|||
Yes, their comparisons are weird.

They also compare their architecture simulation language to RTL, instead of comparing it to existing arcitecture sim languages.

chrisjj 9 hours ago||
> Yes, their comparisons are weird.

Generated by ChatGPT, probably.

amelius 9 hours ago|||
Isn't this more about work-per-joule than about throughput?
motbus3 9 hours ago|||
Yeah. Something smells fishy
checker659 9 hours ago||
Maybe it's Itanium reincarnated
dwroberts 9 hours ago||
Feels like the visualization is doing a lot of heavy lifting, because the explanation sounds quite mundane (randomly rewriting interactions between two points in a program graph?)

It is also written as if this is a new idea for programming languages, but modelling things as a graph of nodes is like 101 stuff?

yvdriess 9 hours ago||
Did they independently rediscover 80's style fine-grained Dynamic Dataflow architectures?

(RIP Arvind)

bhouston 9 hours ago||
> Moreover, single-core CPU performance has largely stalled since the early 2000s, pushing people towards large multicore CPUs such as Intel Xeon, AMD Zen, and NVIDIA Vera.

Huh? Have you tried the Apple's A + M-series of processors? It has dramatically improved performance and tends to increase single core around 15% per year and it compounds.

The drive towards multi-core architectures is real but it isn't because single core performance has stalled, it is that we want to scale faster than single core performance increases.

These are basic facts that this article is getting wrong. How many more basic errors are in this?

nottorp 9 hours ago|
> It has dramatically improved performance and tends to increase single core around 15% per year and it compounds.

Does it, or is that because of the large caches and memory bandwidth? Honest question.

adastra22 10 hours ago||
Why would you hold off evaluation criteria? This isn’t LLM training.
OJFord 9 hours ago|
It's similar: they don't want it designing an architecture that overfits to exactly their 25 evaluation workloads, it's supposed to be general purpose.
dapperdrake 9 hours ago||
The frostbite tiles and their work-stealing is reminiscent of a 2d-grid of basic blocks from compiler design. Register renaming or something similar to it also seems to help building intuition about this.
pshc 9 hours ago||
Instruction nets sound intriguing, but it looks like execution is based on rewrite rules. Does it need a lot of copying and marshalling to get work done?
aurareturn 10 hours ago||
My prediction:

In the AI/AGI/ASI era, the 4 most valuable things will be:

- Model

- Compute (chips/energy)

- Manufacturers

- Materials

You can already see it beginning at the chip design stage. If AI makes it so that it takes 2 months to design a chip instead of 2 years, then there will way more chips designed to accelerate applications that previously weren't viable economically.

Therefore, it's manufacturers like TSMC that will become more valuable. There will be more chip companies, more designs, more demand.

And in order to make things, you need materials.

In order to design the chip, you need the model and AI hardware.

hkalbasi 10 hours ago||
Why you wouldn't ask the ASI to design a TSMC too? Then the silicon (sand) will become more valuable. Even raw materials may become less important if ASI manages to achieve space elevator or something like that. But my prediction is that the growth of current AI generation is hitting end of the S-curve, and an AI era where AI can design chips in 2 months and fabs in 2 years is not as soon as it seems to be.
aurareturn 9 hours ago|||
It's possible ASI can design and build a TSMC as well. But instead of that happening within 5 years, maybe that's 10 years down the line?
barrenko 9 hours ago|||
One giant all-encompassing loop.
zarify 9 hours ago||
Agent Centipede? Seems on brand.
fedpost 10 hours ago|||
Much like with agentic PCB design, the HDL isn't the hard part.
dlisboa 9 hours ago|||
I’d say TSMC becomes less valuable because there will be multiple fabs trying to meet demand. There’s no way for a 10x increase in fab capability to be handled by just the very few companies that exist.

Also most likely these bespoke chips wouldn’t need the latest nanometer processes to work more efficiently, lowering the value of highly advanced EUV machines.

aurareturn 9 hours ago|||

  I’d say TSMC becomes less valuable because there will be multiple fabs trying to meet demand. There’s no way for a 10x increase in fab capability to be handled by just the very few companies that exist.
Fabs follow Rock's law. The cost of a fab doubles every 4 years. https://en.wikipedia.org/wiki/Moore%27s_second_law

Right now, it costs $20b - $40b to create one fab. And that's without the R&D time and cost for the actual node process such as N2.

So could AI recreate TSMC? Maybe in a more distant future. But it's a lot harder to recreate TSMC than to design a chip and send the file to TSMC.

I think it's more likely that AI recreates some chip manufacturing breakthrough than to compete against TSMC without one.

edg5000 9 hours ago||
Maybe Rock's law will change now that AI makes technological development less laborious, which is where the money was going. All non-technical overhead also gets reduced; what a 10-person company can do today assuming they can run their agents 24/7 makes the situation from just 10 years ago look medieval. So we'll see more foundries and more production capacity pop up, nibbling at TSMCs feet.
aurareturn 9 hours ago||
If there is a breakthrough in chip manufacturing, IE, a completely new process, then maybe.

We don't really know that.

We do know that AI is already there or close to being able to design a chip, verify it, and send it to TSMC.

luckystarr 9 hours ago||||
These companies operate under a strict risk modeling framework for their investments, trying to model 10 or so years ahead, because in order to stay profitable they have to shell out 10s of billions at a time. So competition may arise, but very slowly. Heavily simplified.
lazystone 9 hours ago|||
> there will be multiple fabs trying to meet demand

From what I know, that's easier to say, than to implement. Creating a chip is so complex, that it works for TSMC because of the scale. On lower scale, production won't be profitable.

xattt 9 hours ago|||
When design time is compressed to this extent, do subsequent steps that used to be insignificant become the new bottleneck?
petra 10 hours ago|||
I would add "simulation/emulation platform" as one of those things.
DeathArrow 9 hours ago||
>Model

I think China is working towards making the models commodities.

The real breakers will be access to cheap raw materials and to cheap energy.

WithinReason 9 hours ago|
Wouldn't a SIMD/SIMT architecture achieve similar speedups? There are many ways to parallelise programs. What am I missing?
Tuna-Fish 9 hours ago|
You need either the compiler or the programmer to do the parallelization, and in practice the communication costs between cores can be large enough for the parallelization to not be worth it for simple programs.

This ISA seems to be designed to: 1. make the automatic parallelization easy (with workload split between compiler and hardware) 2. make communication costs between tiles very small, so that even very simple workloads can be automatically parallelized.

More comments...