Top
Best
New

Posted by rbanffy 12/18/2025

1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5(www.jeffgeerling.com)
617 points | 228 commentspage 3
daft_pink 12/19/2025|
The next Mac studio is going to be a top seller. I don’t think people want to drop $10k on a few M3s, but I think they will do it for the M6. Just hoping the DRAM shortage doesn’t ruin this plan.
oofbey 12/19/2025|
Apple always charges a huge premium for RAM. Maybe it’s enough to buffer their pricing scheme from the supply shock. I have run the numbers though.
terhechte 12/19/2025||
Tim Cook is famous for locking in their prices years in advance.
newsclues 12/18/2025||
https://m.youtube.com/watch?v=4l4UWZGxvoc

Seems like the ecosystem is rapidly evolving

A4ET8a8uTh0_v2 12/19/2025|
What it kinda reminds me of is PS3 cluster era. Now if I could do something similar to the minisforum..
e28eta 12/19/2025||
> For example: did you know there's no way to run a system upgrade (like to 26.2) via SSH

I did not know this. I thought the `softwareupdate` command was built for this use case, and thought it worked over ssh. It sure looks like it should work, but I don’t have a mac I can try it on right now.

pudquick 12/19/2025|
He's wrong, it's possible. It's just that root privileges alone is insufficient due to how the signing on LocalPolicy works on M series Macs

https://support.apple.com/guide/security/contents-a-localpol...

The manpage for the command provides information on credential usage on Apple Silicon devices.

dsrtslnd23 12/19/2025||
Any thoughts on the GB300 workstation with 768GB RAM (from NVIDA, Asus, Dell, ...)? Although many announcements were made it seems not to be available yet. It does have faster interconnects but will probably be much more expensive.
dogcowmoof 12/19/2025||
Wonder if support for RDMA will translate into support for things such as SMB Direct or if it's really only useful for RAM pooling
polsevev 12/19/2025||
As much as i hate Apples attitude towards hackers and modifying systems. I have to commend them for building awesome features like this
jauntywundrkind 12/19/2025||
I really hope AMD or Intel can get on the clue train and respond.

Intel in particular has half a decade of having extremely amazing Thunderbolt ports on their mobile chips, built in (alas not present on desktop chips, for shame). There's been not bad but not great thunderbolt host-to-host networking, that TCP can go over, but the system to system connectivity had been a total afterthought, not at all tuned for obvious smart readily available options like RDMA here. But nothing stops anyone from having better host-to-host protocols.

There are also so many smart good excellent next steps competitors could go for. CXL is showing up on server systems as a much lighter weight much lower latency transport that is PCIe PHY compatible but lighter weight. Adding this to consumer chips and giving even a third of a shit could blow what we see here out of the water. It could probably be done over USB4 & radically blast this bespoke RDMA capability.

Connectivity had been a bespoke special capability for too long. Intel did amazing with Xeon having integrated OmniPath 100Gb a long time ago, that was amazing, for barely any extra bucks. But the market didn't reward them kicking total ass and everyone gave up on connecting chips together. Today we are hostage to fantastically expensive shitty inefficient NIC that cost a crap ton of money to do a worse job, paying enormous penalty for not having the capability on chip, making at best asmedia io hubs do the USB4 dance a hip away from the CPU.

I really hope Intel can appreciate how good they were, see the threat of Apple kicking as here doing what Intel uniquely has been offering for half a decade with incredible Thunderbolt offerings on-chip (limited alas only to mobile chips). I hope AMD feels the heat and gets some god dMned religion and sees the pressure and thread: man they delivered so strong on PCIe lane counts but man they have been so so so slacking on io capabilities for so long, especially on consumer platforms, and Apple is using both their awesome awesome awesome on-chip memory here and their fan-tastic exceptional ability to care just even the tiniest bit about using the consumer interconnect (that already exists in hardware).

I really really really hope someone else other than Apple can ante up and care. There are so many wins to be had, so close. These companies feel so distracted from the plot. Fucking shame. Good on Apple for being the only mofos to a Tually seize the obvious that was just sitting here, they took no effort nor innovation. What a shame no other players are trying at all.

PunchyHamster 12/19/2025||
Intel is allergic for making consumer stuff good. Remember how in consumer range like half of the chips had fucking virtualisation disabled, long after competition had it on everything ?
pjmlp 12/19/2025||
In the real world, you get a desktop PC with a bunch of GPUs connected on the same bus talking to each other.

No need for multiple computers talking over thunderbolt.

g947o 12/21/2025||
probably need to build your own PC. This is not really possible on most prebuilt gaming PCs.
extraduder_ire 12/19/2025||
Is RDMA only going to be on the studio, or is it coming to anything with a thunderbolt 5 port on it?
saddat 12/19/2025|
A good part of humanities knowledge under your desk running with a few old light bulbs worth of power
More comments...