Top
Best
New

Posted by jonifico 12 hours ago

Thelio Mira AI Linux Workstation: 192 GB GPU Memory(system76.com)
107 points | 98 commentspage 3
LoganDark 9 hours ago|
Is it more powerful than Apple silicon, or why would anyone buy this? Just for Linux?

Oh, it's System76, that's why. Open hardware. Makes sense.

Edit: Also Nvidia

kelvie 6 hours ago||
The prefill rates are way faster on these cards compared to apple silicon, which affects TTFT and therefore usability for a lot of coding tasks, unless you fire and forget most of the time.
numpad0 5 hours ago|||
Mac GPUs supposedly being fastest thing on Earth obsoleting everything NVIDIA is just pure marketing. It was just faster once than some midrange laptop NVIDIA, which conveniently wasn't explicitly marked as different chip sharing the branding with the desktop variant(oof).

The real benefits to going Mac is its quiet and discreet, high wife/CEO acceptance design, and their huge GPU-assignable shared RAM.

If you're okay with your desk being the wing top of a flying airplane, and 3M Peltor or David-Clark is your favorite working time headphone brand anyway, then your build will be faster and cheaper than a maxed out Mac Studio.

LoganDark 4 hours ago||
For me the operating system (and ecosystem in general) is one of the biggest reasons I use a Mac, but the unified memory pool is a benefit too. I am still distraught about the gaming situation though.
wmf 9 hours ago||
It is more powerful than Apple.
LoganDark 9 hours ago||
I wonder why Apple has not really pushed their memory bandwidth numbers. They're starting to catch up to 2020 at this point -- cool, but still struggling to run years-old models. (FLOPS is even further behind by a year or two)

Maybe they're waiting on HBM? Given that they're skipping M6 Max to go straight for M7, I'd assume they're doing a redesign for it.

wmf 8 hours ago||
GDDR has higher latency and much lower capacity. HBM requires an interposer and also has lower capacity. It's not an easy choice. The M7 family will probably double memory bandwidth using LPDDR6.
LoganDark 7 hours ago||
So the MacBooks might get roughly the M5 Ultra's bandwidth in a couple years. Not bad -- my M4 Max is currently stuck in 2016
rrgok 5 hours ago||
Is this just a marketing stunt? From a completely ignorant user, doesn't AI reeuqires high bandwidth ram (like the GPU)? Is really DDR5’s bandwidth enough?
zepearl 5 hours ago|
> 192 GB GPU memory
rrgok 3 hours ago||
How did I miss that? I was still sleeping I guess
protocolture 5 hours ago||
Do I want one? Yes.

Can I afford it? Absolutely not.

chaostheory 6 hours ago||
How is this interesting compared to either a Mac Studio or Nvidia Spark? Did I miss something?
wmf 5 hours ago||
This is a tier above the best Mac Studio and two tiers above the Spark.
coffeebeqn 4 hours ago||
Big GPUs
senectus1 10 hours ago||
wouldnt you be better off maxing out the new Mac hardware? the memory bandwidth is insane on those jobbies
wmf 9 hours ago||
Two RTX 6000 have more FLOPS and more memory bandwidth than a M5 Ultra (but they also cost more).
fsuts 1 hour ago|||
Depends on your use case

If running models then Apple is fine, if training or tuning or large number of users then Nvidia is king

rubyn00bie 7 hours ago|||
There’s roughly 50% more memory bandwidth on an RTX 6000 pro versus the M5 Ultra. I imagine it really comes down to what you’re doing, I know my 5090 runs laps around the M5 Pro I have when it comes to local LLM performance (until it runs out of memory).

If it wasn’t for the fact the 6000 Pro is selling for like 100% ($9,000) over MSRP it would probably look a lot more reasonable.

bigyabai 9 hours ago||
If your goal is pure GPU compute, you should have got a 5090. It can bench comparable to the RTX 6000 Pro cards and is near guaranteed to outperform M5 Ultra.
alescalaios 2 hours ago|
[dead]