Top
Best
New

Posted by RealityVoid 2 hours ago

Arm AGI CPU(newsroom.arm.com)
129 points | 65 comments
aurareturn 35 minutes ago|
This is just a Neoverse CPU that Arm will manufacture themselves at TSMC and then sell directly to customers.

It isn't an "AI" CPU. There is nothing AI about it. There is nothing about it that makes it more AI than Graviton, Epyc, Xeon, etc.

This was already revealed in the Qualcomm vs Arm lawsuit a few years ago. Qualcomm accused Arm of planning to sell their CPUs directly instead of just licensing. Arm's CEO at the time denied it. Qualcomm ends up being right.

I wrote a post here on why Arm is doing this and why now: https://news.ycombinator.com/item?id=47032932

bt1a 23 seconds ago||
Oh wow already in use by Meta, OpenAI, and more ?? https://www.arm.com/products/cloud-datacenter/arm-agi-cpu/ec...

The TDP to memory bandwidth& capacity ratio form these blades is in a class of its own, yes?

steve1977 40 minutes ago||
I think the interesting bit is actually this:

For the first time in our more than 35-year history, Arm is delivering its own silicon products

rafram 29 minutes ago||
AGI (Agentic AI Infrastructure) is joining CSS (Compute Subsystems) in their lineup, apparently. Who’s naming this stuff?
LikesPwsh 11 minutes ago||
The same people who abbreviate "generative" AI in a way that misleadingly conflates it with "general" AI.

Fraud is just the default lifestyle of marketers.

LollipopYakuza 18 minutes ago||
So Artificial General Intelligence and Cascading Style Sheets are not joining forces?
rafram 6 minutes ago||
Always have been :)
throwa356262 1 hour ago||
AGI = Agentic AI Infrastructure

In case you were thinking about some other abbreviation...

conductr 25 minutes ago||
Missed opportunity to call it AAII and market it as twice as powerful as regular AI.
ux266478 58 minutes ago|||
I think this is a poetic encapsulation of the AI industry at this point. A beautifully poignant vignette.
Aerroon 14 minutes ago||
It feels more like "blockchain" to me: https://www.cnbc.com/2017/12/21/long-island-iced-tea-micro-c...
bee_rider 15 minutes ago|||
It’s like they decided to moon all the onlookers while jumping the shark…

I don’t know if it was intentional or they were so far out over their skis that they got their bathing suit caught, but it’s impressive either way.

RealityVoid 1 hour ago|||
It's... really something. Not good. Something.
monegator 16 minutes ago|||
what lenghts are they going to, just to say we have achieved AGI... now who's moving the goalpost?
esafak 27 minutes ago|||
The coast is clear to come up with your own expansion for AI!
artyom 25 minutes ago|||
Not bait at all
hootz 1 hour ago|||
What a terrible, terrible name.
charcircuit 53 minutes ago|||
AGI stands for Artificial General Intelligence.
lock1 18 minutes ago|||
Pretty sure it stands for "Artificial abbreviation & hype GeneratIon" nowadays
hagbard_c 46 minutes ago|||
Are you sure it doesn't stand for Advanced Guessing Instrument? That's what the result often seem to indicate after all.
lupajz 1 hour ago|||
I mean, they could at least use AI to figure out how to name their AI product.
embedding-shape 12 minutes ago|||
> I work at ARM, we're launching a new CPU optimized for LLM usage. We're thinking of calling it "Arm Agentic AI Infrastructure CPU", or "Arm AGI CPU" for short. Do you think this is a good idea?

> No. I would not use it as the product name. “AGI CPU” will be read as artificial general intelligence, not “agentic AI infrastructure,” so it invites confusion and sounds hypey.

To bad these executives seemingly don't have access to ChatGPT.

_ache_ 26 minutes ago||||
They did ask AI if AGI what a great name. It said that it was the greatest name possible. It's bold, aspirational, and ... polarizing?!

Oh god! Mistral tell me it's highly polarizing, will make the buzz and it's risky but anyway people will know that ARM is doing CPU again now (maybe I did put too many context).

foolproofplan 30 minutes ago|||
maybe they did and why they got this slop?
SilverElfin 47 minutes ago|||
They pathetically don’t mention what it stands for anywhere in this press release. Deceptive marketing at worst, shameless AI-washing at best.
WhrRTheBaboons 43 minutes ago||
I would've went for Agentic Neural Infrastructure personally

ARMANI for short /s

mkl 58 minutes ago||
This is like naming your kid World President Smith.
rboyd 46 minutes ago|
This could work. Right? https://psycnet.apa.org/record/2002-12744-001

My realtor's last name is House

technothrasher 8 minutes ago|||
> Studies 1-5 showed that people are disproportionately likely to live in places whose names resemble their own first or last names

There are several cities in the US that share my last name. I don't live near any of them.

> Study 6 extended this finding to birthday number preferences.

D'oh!

conductr 19 minutes ago||||
> Studies 1-5 showed that people are disproportionately likely to live in places whose names resemble their own first or last names (e.g., people named Louis are disproportionately likely to live in St. Louis).

When I lived in Austin, it seemed like a third of boys born were being named Austin. I presume many of them will end up living there as adults but not because of this particular bias, because they were raised there and have family’s there seems to be a more likely driver.

chrisweekly 12 minutes ago||
"Nominative determinism" is everywhere once you look for it. My vet's last name is McStay.
IshKebab 42 minutes ago|||
Reporting bias.
yabutlivnWoods 1 hour ago||
How fun would it be if due to improved chips handling more model state RAM needs are reduced and Sama cannot make all those RAM purchases he booked?

VC without a degree who has no grasp of hardware engineering failed up when all he had to do was noodle numbers in an Excel sheet.

He is so far behind the hardware scene he thinks its sitting still and RAM requirements will be a nice linear path to AGI. Not if new chips optimized for model streaming crater RAM needs.

Hilarious how last decades software geniuses are being revealed as incompetent finance engineers whose success was all due to ZIRP offering endless runway.

gtowey 1 hour ago||
The thing they are good at is bullshitting and selling hype. Which we see here doesn't mean they are actually going to be good at running a business. Smart leaders understand they are not omnipotent and omniscient so they surround themselves who know how to get things done. Weak, narcissist leaders think they're the smartest one in the room and fail.

Unfortunately failing upwards is still somehow common, probably because the skill of parting fools from their money is still valuable.

thereitgoes456 56 minutes ago||
No, he is also good at networking. When OpenAI was mission-driven and Sam was more respected, he could convince the most talented people to work for him.

Now the talent is going to other places for a variety of reasons, not all due to Sam (one of which is little room for options to grow). However it’s hard to believe his tanking reputation is not badly hurting the company. Other than Jakub and Greg, I believe there are not many top tier people left, those in top positions are there because they are yes-men to Sam.

mhjkl 1 hour ago||
What RAM? OpenAI booked the silicon wafers, they can print anything they want on them. I wouldn't call them "far behind" on hardware when OpenAI are actively buying Cerebras chips.
midnightdiesel 19 minutes ago||
What a product name choice! I wasn’t expecting ARM to pivot to selling snake oil.
josemanuel 11 minutes ago||
Interesting that Jensen Huang joined in the congratulations for this new product!
papichulo2023 1 hour ago|
What does "Built for rack-scale agentic efficiency" even means?
throwa356262 53 minutes ago||
If you read past the marketing talk, this is basically a massively multicore system (136) with significantly reduced power usage (300W).

Where does Agentic come into this? ARMs explanation is that future Agentic workloads will be both CPU and GPU bound thus the need for significant CPU efficiency.

inerte 1 hour ago|||
It's volume of tokens consumed x number of agents x rack space. Basically agentic computation density.
ray_v 1 hour ago|||
We just say words now that sound good for marketing but have no real meaning.
thewebguyd 55 minutes ago|||
Big "but mongodb is web scale" vibes
varispeed 1 hour ago|||
It's a code sentence for let's go to the utility room to cross pollinate ideas.
r_lee 1 hour ago|||
I was gonna say just big DCs in marketing yap but really wtf does that mean?
otabdeveloper4 1 hour ago|||
It's when LLM agents are inefficient that you need a whole rack of servers to get shit done.
sdwvit 1 hour ago||
Translation: “Can you give us some money pretty please?”
More comments...