Top
Best
New

Posted by ihsw 5 days ago

Meta reuses old RAM in new servers with custom bridge chip(www.networkworld.com)
236 points | 159 comments
snowwrestler 4 hours ago|
At the beginning of William Gibson’s Neuromancer, the protagonist is trying to sell 3 MB of RAM in underground markets. This is often cited as one of the ways the book has not aged well. But, looking at the direction of the memory market now… maybe we just haven’t gotten there yet.
ecshafer 3 hours ago||
Early computer scientists were so optimistic. They beleives with a few kh of ram and a mhz of cpu they could do anything. Ai, consciousness, ml, language, text to speech. Now we spend gigs of ram on web forms. So gibson saying yeay 3MB of ram would probably be enough for a consciousness in cyber space, is very optimistic but fitting.
neonmagenta 1 hour ago|||
I remember when Johnny Mnuemonic came out and he was hauling 320 GB in his brain and that was a WHOA moment.
goodmythical 54 minutes ago||
To be fair, that's the entire text of Wikipedia in multiple languages.
dfedbeef 2 hours ago||||
3MB of RAM but 120PB of storage. Sure you're paging a lot but
bigbuppo 1 hour ago||
Make your secondary storage smarter.
brnt 20 minutes ago||||
Maybe there is a parable here: don't fear the man that wants thousands of gigabytes, fear the man that only wnats 3 MB.
satnhak 1 hour ago||||
I saw a chrome tab this week that had Gmail with an empty inbox idling at 2.8Gb. Hard refreshed the page. Still 2.8Gb.
refulgentis 23 minutes ago|||
"Early computer scientists were so optimistic. They beleives with a few kh of ram and a mhz of cpu they could do anything." -- this isn't true, much less the stuff layered on top (conciousness!?)
jonathanlydall 3 hours ago|||
Memory in particular is something that I've reflected on more than once as having the most impressive gains in computing since I started paying attention to it (networking/USB too, but that doesn't make your computer "faster" in the same way).

I remember being able to borrow a computer from somewhere when Diablo II had just come out in 2000 which had a 450Mhz Pentium III and 64 MB of RAM. 64MB of RAM was probably mid-tier at the time, i.e. very much not a given. As I recall Diablo II recommended 64MB for single player and 128MB for multiplayer (or above 4 players or something).

The computer I'm writing this on has 64 GB of RAM, 1024 times as much. By comparison I have a 20-core Intel CPU with up-to 3GHz speed or somewhere around there, even pretending each core could run at that max speed simultaneously (which they can't), that's only 133-times as much CPU power.

Maybe the NVMe read times are as/more significant than memory size increase, but the metrics on them isn't quite as front and center on PC specs as memory and CPU.

Hard drive capacity similarly impressive as RAM in terms of size (was apparently 10-30GB in 2000), but I don't have a 10TB hard disk as I don't need one that big (1TB is plenty for me), so again it's not as impactful to me as memory.

pedrocr 3 hours ago|||
> The computer I'm writing this on has 64 GB of RAM, 1024 times as much. By comparison I have a 20-core Intel CPU with up-to 3GHz speed or somewhere around there, even pretending each core could run at that max speed simultaneously (which they can't), that's only 133-times as much CPU power.

Over that time CPUs have also increased their instructions per clock by 3 to 4 times, so the comparison is a bit closer than that. 5Ghz in CPUs is also common these days which would make it even closer. RAM has also improved in more than just total size though.

martinald 25 minutes ago|||
GPUs are even more extreme. A 5060 is something like 15,000x faster than a 3dfx Voodoo card from ~2000 by my limited research.
deeringc 1 hour ago|||
I completely agree. With everything from Out-Of-Order execution, deep pipelines, SIMD, huge CPU cache, etc... I would be surprised if the performance increase is not considerably more than 1024x.
eightysixfour 1 hour ago||||
> The computer I'm writing this on has 64 GB of RAM, 1024 times as much. By comparison I have a 20-core Intel CPU with up-to 3GHz speed or somewhere around there, even pretending each core could run at that max speed simultaneously (which they can't), that's only 133-times as much CPU power.

This nerd sniped me a bit. Your calculation on the amount of CPU power is too low, because of the change in IPC, but for the things we have benchmarks for, it isn't multiple orders of magnitude off like I expected. Looking at Cinebench 2003, prime95, and a few other benches, I get somewhere between 300x and 850x faster for the modern CPU over the Pentium 3.

For me, the biggest change in performance in my life was going from spinning disks to SSDs. That change felt bigger than any other leap by a long shot.

BrtByte 9 minutes ago||||
The funny part is that a 1000x increase in RAM somehow doesn't make a modern computer feel 1000x more luxurious
thewebguyd 2 hours ago||||
> Maybe the NVMe read times are as/more significant than memory size increase

This was the most impactful upgrade/breakthrough for me. The first time I put even a SATA SSD in my PC at home I was completely blown away. It still blows my mind somewhat the amount of compute I have sitting on my desk though, both in terms of memory and CPU/GPU power, but that move from spinning rust to solid state was huge.

Then Apple did to me again with the M1 launch and NVMe speeds that made swapping nearly imperceptible.

longitudinal93 1 hour ago||
Me too. I distinctly remember saying that I would never own a non-solid state boot drive again.
Keyframe 1 hour ago|||
that's only 133-times as much CPU power

akshually, it's also more closer to 500-1,000x. You can't look at clock speed only. Processor architecture makes all the difference. Pipelining, SIMD, memory bandwidth, blablala, everything got way better. Better approximation would be to use something like a synthetic benchmark or just (theoretical) FLOPS of each.

Otherwise, we can say that 6502 at 15Ghz is better than what you have now: https://news.ycombinator.com/item?id=22859706

fredsmith219 2 hours ago|||
That is a pretty nitpicking reason to say it has not aged well. Hamlet doesn’t have cell phones yet I think it’s an excellent play. Even though a quick FaceTime would’ve averted a tragedy.
craftkiller 2 hours ago|||
So many plots in Seinfeld would have been trivially solved with cellphones. Get separated in the parking garage? Call each other. Need help carrying an armoire? Call each other. Trying to meet up at the movie theater? Call each other.
mrweasel 1 hour ago||
You still see this in many newer movies. If they are set in the present step one is "oh no, we have no cell service". There are so many movies and TV shows where the plot doesn't work if you have cell service or internet access.
arijun 2 hours ago||||
Hamlet is set in (what is currently) the past. It is self consistent. Neuromancer is set partially in the future, and partially what is our past. The inconsistency is what throws people. It can be a good book, but people might still find those elements jarring.
soiltype 2 hours ago|||
Hamlet is not a science-fiction story set in the future.

This is a shockingly ill thought-out comment tbh. I don't want to assumr you're an LLM, perhaps we can blame morning grogginess.

nullstyle 2 hours ago||
Ah, and we now see casual bigotry emerging from the anticlanker crowd. What a shame.
soiltype 1 hour ago|||
What are you talking about? Bigotry against a program that's literally incapable of understanding semantic meaning?

To say "anticlanker" sounds like you hate LLMs, or do you approve of them and you use that term disparagingly? I am not "anticlanker" I'm just a person who is aware that unscrupulous people very very frequently have LLMs generate comments and posts for them

ewild 2 hours ago||||
Is this ironic are we actually calling shit talking llms bigotry?
nullstyle 1 hour ago||
no, we're talking shit about people who express their bigotry with anticlanker sentiment, calling humans (whom they disagree with) llms.
soiltype 1 hour ago||
I didn't call that commenter an LLM, despite what I'd consider an embarrasing lack of mental model of what it means for a speculative fiction novel to age poorly. Who am I bigoted against?
nullstyle 55 minutes ago||
so we're on the same page, here's how I read your comment:

"This is a shockingly ill thought-out comment tbh." <-- the casual bigotry;

"I don't want to assumr you're an LLM" <-- yes you do, dont be a dunce. this is the anticlanker sentiment.

"perhaps we can blame morning grogginess." <-- or it's an honestly held opinion expressed earnestly, and you did nothing to explain why you disagree, hence me calling your post casual bigotry

cliglot 1 hour ago|||
[flagged]
nullstyle 1 hour ago||
Lol
mNovak 2 hours ago|||
If I recall correctly, Gibson had never even used a computer at the time of writing Neuromancer, so that's perhaps not shocking.
moomoo11 1 hour ago||
this is my issue with cyberpunk “literature”

it’s a genre written by people who barely understand technology and consumed by even more luddite types.

it’s all uninformed fear mongering

rf15 1 hour ago|||
It's certainly Literature. Shouldn't the quotes be more like '"cyber"punk literature', considering your complaint?
moomoo11 51 minutes ago||
the games are more interesting imo. like deus ex or even cyberpunk 2077
msie 52 minutes ago|||
Then you should have a problem with science-fiction in general.
gchamonlive 2 hours ago|||
Can't you just read "3 MB of RAM" as a large amount of some scarce tech resource and move on?

What if you got a on-chip compression algorithm so advanced that you can fit a world in a few MB and now with corporations controlling memory distribution, 3MB of high compression memory is highly valuable in the black market.

bartread 2 hours ago|||
It's funny... I enjoyed Neuromancer, although I didn't read it until about 15 years ago.

And, yeah, the memory thing hasn't aged well. Thing is, 1984 was a funny time in computing, particularly when you consider the kind of computers normal people had access to.

At that point even things like PCs and the new Mac had 128 or 256K of RAM[0], so I get that 3MB must have seemed like an ocean of memory at the time. And, realistically, more than 1MB of RAM in machines you'd typically see sat at home or on a desktop was uncommon until the beginning of the 1990s.

And, although Moore's law had been around since 1965 it's hard to know how aware people outside of specialist circles would have been of it in 1984.

I suppose Gibson must have done some pretty in depth research for Neuromancer, right? But the memory thing is sort of ancillary to the story, so how much would he really have focussed on that? Probably not much.

And then do you really want to harshly judge the book on that one slightly laughable thing, in other ways, it was incredibly forward looking and almost prophetic? Doesn't seem right.

I think the sensible position is you have to let it slide and see it as a possible alternative future that never quite came to pass in that way but that which we can see strong echoes and foreshadowings of even still.

[0] In 1984 microcomputers, as opposed to, cough, "serious" computers like the PC and Mac, with 128K of RAM were still very new, with 32 - 64K being the entry level, and if you had one with 128K you were king of the hill. 128K in 1984 seemed like a ton of memory to most of us, but it's worth bearing in mind that only a handful of years before computers like the ZX81, which had only 1K of RAM, were the common entry level, so the progression was already clear if you looked at the situation in the right way, but you had to have been paying attention for a while to have noticed. I remember the first time I used a machine with 4MB of RAM in, maybe, 1990 - an Archimedes at school - and feeling like it was just this absolutely inexhaustible ocean of memory. In 1984 3MB would have felt almost inconceivably huge unless you were in the high performance computing, or maybe the mainframe, worlds.

nottorp 2 hours ago||
> But then Gibson must have done some pretty in depth research for Neuromancer, right?

Isn't he on record that his documentation was listening to techies talking shop in bars?

> And then do you really want to harshly judge the book on that one slightly laughable thing about memory when, in other ways, it was incredibly forward looking and almost prophetic.

He seems to understand humans. Gibson's world and Brunner's Stand on Zanzibar are imo the most "prophetic" sf books written so far.

bartread 2 hours ago|||
> He seems to understand humans.

Yeah, I think this is it. The humans were the point, not the minutiae of the tech.

(Btw, I hadn't noticed you'd responded whilst I was editing my comment to express myself a bit more clearly - I hope anyway - so the quotes don't quite match but I don't think it matters, because the sentiment is hopefully clear enough both ways!)

kergonath 2 hours ago|||
> Isn't he on record that his documentation was listening to techies talking shop in bars?

Yeah. I don’t think he was a technophile himself. Which might have helped him because he was not trying to be realistic. But at the same time there are things he understood deeply.

AdamN 4 hours ago||
It's sort of a cool idea. "Pre-RAM" without the tracking/AI integration so it can be used for clandestine activities in a dystopian future.
kilpikaarna 3 hours ago||
It's 3MB of "hot" RAM, IIRC. Makes sense.
rob74 8 hours ago||
Why not go directly to the source article that has a lot more details?

https://www.theregister.com/systems/2026/06/29/zuck-saves-me...

pjc50 7 hours ago||
Source paper linked is https://aisystemcodesign.github.io/papers/isca26/vistara_cam...

From a quick skim, you could think of this as roughly equivalent to shoving a large amount of DDR4 on a PCIe card and using it as a swap space. It's more sophisticated (see CXL protocol), but that gives you an idea of the tradeoffs. It seems there is some OS-level support for moving hot/cold pages between the main fast DRAM and the expansion higher latency DRAM.

It's a very valid point that DRAM has a fairly long lifetime and contains significant embedded carbon emissions, as well as the current availability crisis of new DRAM.

herodoturtle 6 hours ago|||
> and contains significant embedded carbon emissions

Hi - thanks for the insightful comment - could you please expand on the above?

Genuinely curious :)

pjc50 5 hours ago|||
From the paper:

"Second, memory dominates the carbon footprint of the fleet [8], accounting for 69% of CO2 emissions and posing a significant sustainability challenge [4]. DRAM dominates datacenter embodied CO2 largely because it is ubiquitous and deployed in large quantities across essentially all servers. Based on our internal fleet data, and aligned with studies from other hyperscalers such as Microsoft [33], memory is one of the largest single embodied-emissions contributors"

[8] U. Gupta, M. Elgamal, G. Hills, G.-Y. Wei, H.-H. S. Lee, D. Brooks, and C.-J. Wu, “ACT: Designing Sustainable Computer Systems with an Architectural Carbon Modeling Tool,” in Proceedings of the 49th Annual International Symposium on Computer Architecture (ISCA’22), 2022.

[4] D. Azevedo, M. Patterson, J. Pouchet, and R. Tipley, “Carbon usage effectiveness (cue): A green grid data center sustainability metric,” White paper, vol. 32, 2010.

[33] J. Wang, D. S. Berger, F. Kazhamiaka, C. Irvene, C. Zhang, E. Choukse, K. Frost, R. Fonseca, B. Warrier, C. Bansal, J. Stern, R. Bianchini, and A. Sriraman, “Designing Cloud Servers for Lower Carbon,” in Proceedings of the 51st Annual International Symposium on Computer Architecture, ser. ISCA ’24, 2025, p. 452–470.

Not a reference, but I found https://www.interface-eu.org/publications/semiconductor-emis... which goes into great detail on the subject. I hadn't realized there were significant emissions of fluorinated gases directly from the fabs, which is mildly alarming. Although it looks like there has been a crackdown on this either politically or through ESG policies.

lmz 6 hours ago||||
"a lot of carbon was emitted while making it"
NDlurker 6 hours ago||||
Reduce, reuse, recycle
ryukoposting 3 hours ago|||
I see what you did there.
jonhohle 2 hours ago|||
I’ve wanted this for a long time and it seems to reemerge during RAM boom cycles and then disappear during busts.

I have 32GB of DDR3 that would be great for scratch space or cache of i could throw it on a card.

ozgrakkurt 4 hours ago|||
It is amazing how this is attributed to "zuck", like he actually knows these things.
rob74 4 hours ago||
That's just El Reg being El Reg (the Zuck-buck rhyme was apparently too good to pass up). But it's a far cry from their glory days, when they coined nicknames like "The Beast of Redmond" for Microsoft or "Chipzilla" for Intel...
embedding-shape 7 hours ago|||
> Why not go directly to the source article

Which seems to be the sister site of Register; https://www.blocksandfiles.com/architecture/2026/06/26/panmn...

Cuuugi 3 hours ago||
The writers name is Maxwell Cooter, which made me giggle.
kjs3 5 hours ago||
I have always wondered why there was never a big market[1] for "cheap PCI/PCI-X/PCI-e card you can stick a boatload of your old/surplus/n-generation old simms/dimms on and use as swap/slow memory/ram disk/etc". It's rare you can populate a motherboard with a full address space full of 'new' memory, and you can teach kernels to prefer some memory to others because of speed[2], so it seems like a no-brainer.

I seem to remember the market for doing similar with flash got neutered over patent issues, but I can't recall the details. And flash cache did end up being a market, at least for bigger players. Maybe something similar happened here, or maybe it just hit a niche I cared about at the time?

[1] I know there were a handful of products in this space, but my impression is they never really took off. I could be wrong. [2] Definitely can in NetBSD; I've done it for archs like VMEbus where it's common to have a small, fast on board memory and much slower, often larger memory out on the bus. I assume this sort of thing is enabled in Linux by the work to support NUMA, but I've never looked into it.

SoftTalker 4 hours ago||
There was never a big market for it because new memory was not prohibitively expensive in comparison to the cost, risk, and limitations of using old memory in a new server. That is not the case now, so people are looking at the idea again.
kjs3 4 hours ago||
That's a fair take and likely the answer.

I would counter tho that 1) this isn't the first time there's been a memory price/supply crunch, and "I've got a drawer full of last gen memory I can't use" is kinduva IT cliche, and 2) 'more memory' has always been a pain point, especially with industry practices like chipsets only supporting relatively small physical memory relative to address space (e.g. all those Intel LGA775 chipsets that capped at 4 or 8GB). Oh, and 2a) 'faster disk' has always been a pain point...

But, yeah...obviously my impression of things doesn't match market reality.

deltoidmaximus 2 hours ago||
I think these products were always niche for the reasons parent suggested, I recall their price and max capacity being unappealing when I was looking to make use of a drawer full of obsolete RAM. But since there were several iterations from a few companies they must have sold well enough to justify their development.

They seemed to stop making them altogether around when SSDs came out which probably shrunk the market niche right out of viability.

BrtByte 8 minutes ago|||
Funny how the idea only seems to become practical once you have a literal warehouse problem worth of old RAM
matt_heimer 4 hours ago|||
Not exactly the same but I'm building a NAS box with old parts. Most of my spare RAM sticks are laptop DDR4 SODIMMs. There are SODIMM -> desktop DIMM adapters... it did not go well. The system would boot 1 out of 5 times. No adjustment of memory speed settings would make the system stable.
kjs3 2 hours ago||
That's not surprising. At the speed DDR4 runs, PCB design has to account for all sorts of weird effects. Adding the additional traces on the adapter probably pushes all sorts of timing over acceptable thresholds. There's a reason one of the big textbooks in the area is subtitled "A Handbook of Black Magic". [1]

[1] https://www.amazon.com/High-Speed-Digital-Design-Handbook/dp...

lizknope 3 hours ago|||
30 years ago I remember cards like this to convert 4 30-pin SIMM modules to fit in a 72-pin SIMM slot.

https://www.ebay.com/itm/383521792853

kjs3 2 hours ago||
Oh, yeah...I remember those. I prolly have one in a box someplace. They were pretty terrible. :-)
citrin_ru 1 hour ago|||
Old generation DIMMs are not that much cheaper and supply is limited as old generation are taken out of production to free capacity for newer chips. DDR2 is already more expensive than DDR3, likely because it is no longer produced but there is still demand (to replace/upgrade memory in older hardware).
toast0 3 hours ago|||
My understanding (which could easily be wrong), is the big difference today is CXL which adds cache coherency on top of pci-e.

Without cache coherency, you have to be more careful about how you use the memory and the performance story is complex. Ram over CXL is going to have worse perf than ram on the cpu memory controller, but there shouldn't be any big gotchas.

jayd16 2 hours ago|||
Nvme drives already max out the 4x pcie lanes they get. You'd basically need to use the GPU slot to do better and even then you could do it with SSDs. M.2 break out cards are pretty common.
undersuit 2 hours ago|||
Cost for me. I wanted a Gigabyte I-ram but it was too expensive when I only had one 512MB DDR stick after upgrading to 4GB of DDR2. I bought a 60GB Sandforce SSD that fulfilled that speed gap.
wmf 2 hours ago|||
Honestly DIMMs don't really fit on PCI cards and a boatload definitely doesn't fit.
reaperducer 3 hours ago|||
I have always wondered why there was never a big market[1] for "cheap PCI/PCI-X/PCI-e card you can stick a boatload of your old/surplus/n-generation old simms/dimms on and use as swap/slow memory/ram disk/etc"

Reminds me of the days of JBOD arrays. Mac OS X had built-in support for it.

JBOR?

kjs3 2 hours ago||
JBOD arrays are still a thing. They've even evolved a bit (see: UnRaid).
chadgpt3 4 hours ago||
They used to exist
kjs3 4 hours ago||
Go back and read beyond the first sentence; you'll see I said exactly that.
grepfru_it 2 hours ago||
Kind of. You referenced flash memory. However I owned an ibm ps/2 from the 80s which had an MCA memory card which could accept SIMMs and extend system ram. So maybe the previous poster is being pedantic? No need to downvote them
kjs3 2 hours ago||
Yes...I remember the model 80. The cards you're talking about are 1) a design choice IBM made to use MCA as the official way to expand memory in the machine and not something any PCI bus machine I'm aware of followed, and 2) used the same generation memory as the planar memory. I don't think you're talking apples to oranges. YMMV.

I'm not sure where 'pedantic', especially when coupled with 'contributes nothing to the discussion', wasn't worthy of a downvote (which I didn't give), but I'm sure there's a "well, ackshually..." rationale there someplace.

Edit: extra 'not' removed.

BrtByte 11 minutes ago||
The impressive part is not really reusing old RAM, its making the economics work despite the extra chip, software support and operational complexity
lizknope 7 hours ago||
There are standard product CXL memory expander chips if you don't want to design a custom chip.

https://www.marvell.com/products/cxl.html

jzb 7 hours ago||
It’d be nice if there were a consumer version of this. I have plenty of old RAM.
keanebean86 6 hours ago||
Gigabyte had a ram disk addin card years ago. Not exactly the same but since it's presented as a storage device you could use it as OS swap space.

https://en.wikipedia.org/wiki/I-RAM

edb_123 4 hours ago|||
CXL Vistara reminds me a bit of the AST Rampage 286 memory expansion ISA card I had in my 286 back in the day, as a kid. Things go in circles, I guess.
darksim905 4 hours ago|||
observation that I've noticed recently: what's with wikipedia downsizing the hell out of images site wide? Every image I look at is garbage and I have to dig through multiple links to find the original.
3form 3 hours ago||
I saw this with screenshots already for like 10-15 years now? It's some overly conservative policy to comply with fair use. I recall a page outlining that you should basically pick the minimum possible resolution that still allows you to distinguish the features of interest. I get why they do this, but it's really horrible from archiving and accessibility perspectives... And I would like to treat Wikipedia as one of the main archives of the world's collective knowledge.

All this goes to my "world has gone insane over IP law" bucket. Similar to people disallowing their games being streamed or even shared in screenshots.

qlte 3 hours ago||
I don’t think that’s applicable here?

It says the source photo was uploaded as original content by a user in 2011 as a 400x300 JPEG created on an iPhone 3GS per EXIF data, with copyright released as public domain.

There’s nothing to suggest it was downscaled in the log or copyright encumbered, it just looks like it’s old/small. I often click into Wikipedia/Wikimedia Commons images where the original is available as a super high resolution option in addition to various smaller thumbnails.

https://commons.wikimedia.org/wiki/File:IRAM13a.JPG

Aurornis 4 hours ago|||
Adding the RAM to the system this way isn’t exactly like expanding the main system RAM. The RAM is connected over a PCIe type link so it doesn’t behave like the primary RAM.

It’s better for server farms where engineers can customize and tune for an architecture like this.

There have been some cards that use RAM as a storage device. They were never popular because having to set it up as a disk had very limited use cases.

rpcope1 28 minutes ago||
To someone not familiar with CXL that still gives the wrong impression. As far as I have seen, CXL is supposed to be cache coherent, and should require less invasive rework (if any at all) of applications to take advantage of it; that's part of the enablement of memory disaggregation that CXL is pushing towards (similar to the storage disaggregation push a decade or so ago).
zamadatix 2 hours ago||
The sensibility is a bit different since consumer systems don't really have much bandwidth back to the CPU. Given the current resale prices of DDR4, might as well just sell it and get some NVMe drives.
ateles 5 hours ago||
ServeTheHome already reported on CLX memory expansion controllers back in December: https://www.servethehome.com/hyper-scalers-are-using-cxl-to-...
HumblyTossed 4 hours ago||
It will be interesting to see what happens to the consumer electronics market the next few years. Companies are right now gambling that consumers will pay extra because of RAM shortages. I suspect with the cost of everything else rising as well, a large portion of consumers (remember, HN, not everyone makes tech money) will just not be buying new devices for a bit.
CTDOCodebases 2 hours ago|
I think I'm in this boat. I'm just choosing to interact with technology less. Everything has just gotten more hostile that it has reached a tipping point.
rock_artist 8 hours ago||
The interesting part of this "RAM crisis" is similar to other fields where a problem results multiple parties looking for alternative solutions.

This yields for exciting ideas or workarounds that might result a post-crisis memory boom (hopefully) also for local machines.

1. Lowest, Apple is evaluating new Chinese manufacturer which means change of supply demand if indeed it has reasonable QA. (https://www.ft.com/content/f4ac5c92-03be-4499-b16a-017a7e9ee...)

2. Companies tries to workaround performance - suddenly single channel is 'ok' ? :) (https://www.gigabyte.com/press/news/2403)

egorfine 7 hours ago||
> suddenly single channel is 'ok'

Single channel RAM surely beats any disk-based swap.

rock_artist 4 hours ago||
of course, but I was under the impression the real shortage is RAM mostly.
HumblyTossed 6 hours ago|||
I would love it if we started designing software with hardware constraints in mind again.
porksoda 5 hours ago||
We do already, if it ooms at 32g I have to prompt again /s
dofm 6 hours ago|||
Necessity is the mother of invention, after all. (One of the oldest abstract concepts in intellectual thought, I suspect.)

There is a tight resource starvation/motivation loop — the demand put on RAM and SSD and GPUs by the largest frontier models is a direct motivation to make smaller LLMs. Like an evolutionary pressure making animals smaller and more food-efficient.

These smaller models, once successful, are still likely to consume more RAM and SSD and GPUs than any other application short of high quality video processing itself (the smaller LLMs and higher end video processing seem to have about the same needs). But the resources would distribute through the market more traditionally, leading to less insane cycles.

So it seems to me that the way out of the RAM/SSD price cycle crisis that manufacturers are in — where the price fluctuates between high and low due to supply constraints and then oversupply from new production capacity - is for them to fund research into smaller LLMs. They'll still sell essentially the same amount of product. Maybe more.

tonyedgecombe 6 hours ago||
Necessity is the mother of invention.
Schlagbohrer 5 hours ago|
From the paper:

"Our CXL solution achieves substantial gains for diverse workloads, including up to a 25% reduction in server count for disaggregated ML inference"

How does using worse RAM result in 25% reduction of server count for given workloads?

LtdJorge 3 hours ago||
CXL is adding "slow" RAM over PCIe, basically. Not replacing.
dboreham 5 hours ago||
Because it's used in addition to, not in place of, the better RAM.
More comments...