Top
Best
New

Posted by jonifico 11 hours ago

Thelio Mira AI Linux Workstation: 192 GB GPU Memory(system76.com)
105 points | 86 commentspage 2
bitbasher 10 hours ago|
It only costs $40,000.
jillesvangurp 4 hours ago||
People routinely buy cars that cost double that. This is a machine that people that typically earn six figure salaries use to do their work on. Exactly the target demographic that would buy/lease expensive cars as well. And then those get used mainly to commute to work.

I don't really need one. But I do have a 4.5K mac book pro for work. Yes it's a bit overpowered. But it's the main vehicle with which I earn a living and it routinely saves me time by blazing through builds and generally doing things quickly for me. I have slightly more GPU on that thing than I need. But it's nice to have the option to experiment with some of the open weight AI models.

embedding-shape 6 minutes ago|||
> People routinely buy cars that cost double that.

Maybe it's the "routinely" or the "people" part, but "people" generally don't ever buy a 80K car, it's a small fraction of the population who can afford such luxury cars. And I'm sure the ones who buy cars for 80K, unless they're car enthusiasts or just plain billionaires, don't do so "routinely" either.

coffeebeqn 3 hours ago|||
And you would buy it through your company so it won’t be quite as much net. Surely no one is buying these just for fun
embedding-shape 5 minutes ago||
> Surely no one is buying these just for fun

-_-

Some of us worked hard in life and have spare money, sue me!

mandeepj 9 hours ago|||
the landing page showed "$3,299.00" and I had my candy store moment for a few secs.
jgalt212 8 hours ago||
5 years ago I could not afford top shelf coders. Now I cannot afford top shelf machines.
nullbio 8 hours ago||
New car or a Thelio. Tough decision.
andsoitis 2 hours ago||
Second-hand car is more rational than new car.
catchnear4321 8 hours ago||
I bought a spark instead of a motorcycle so it’s somewhat relative and it’s also somewhat relative.
whartung 5 hours ago||
There was a time when I sold my computer and bought a motorcycle.

Can honestly say that was one of the best trades I’ve ever done. I didn’t buy another computer for 3 more years.

embedding-shape 4 minutes ago||
Sold my computer + DLSR camera back in the day to afford moving countries. Can't imagine what life would have been if I didn't, very happy I did. Lived with a netbook for 2-3 years, but was before I was a professional programmer.
rkagerer 9 hours ago||
What motherboard do they use? (Or do they design their own now?)
xeeeeeeeeeeenu 9 hours ago||
The ASUS logo is visible in the photo of the innards.
embedding-shape 9 hours ago||
I'm guessing it'll depend on the GPU (and CPU) choice, putting the cheapest that is sufficient for the choice.
rubyn00bie 7 hours ago||
Anyone know why they chose a consumer grade CPU on this? I’m a little surprised to see a 9950X as the top option. There’s not enough PCIe lanes available to run everything without bifurcation. I imagine the GPUs probably aren’t too bothered generally… but the NVMe drives are likely to slow down as a result.

A Threadripper ain’t cheap, but if you’re spending $45k on a workstation it seems like a weird place to skimp. Not to mention you’d then have the option of shoveling a few more 6000 pros in it when you want to run something larger (assuming your home/office electrical box can support it).

dannyw 4 hours ago|
You need far more absurdly expensive RAM (RDIMM/ECC?) for a threadripper. Like 4x more expensive.
rubyn00bie 4 hours ago||
Aye but at $45k you’re so deep already is that really worth the savings? It’s so much easier to manage a single system, and the performance will be in absolute terms better.

Truly, I get your point, but $45k is obscene for a workstation (because of the RAM shortage). I can’t fathom it being a reasonable decision[1] unless you’re able to churn an immense profit from it. And… if you can, it’s an expense that saves time, energy, and effort. If it is only profitable when $8k in price difference makes it viable, is that really worth the effort? An $8k increase making a difference, when you’re wholly dependent on the frontier (or near frontier) lab not releasing a model that makes your work(station) irrelevant— seems reckless. Couple that with the doubling of DeepSeek’s parameters for their flash model… and well the math just don’t math for my naive brain.

[1] I’m absolutely incapable of spending that much on a workstation so my opinions may be irrelevant… but I cannot understand the “stepping over quarters to save a penny” mentality[2].

[2] I could be missing the forest for the trees. As a result, I’d love to know how I am being shortsighted. I just can’t fathom a situation where an $8k surcharge in system RAM doesn’t make sense. It’s not about system RAM, it’s about GPU RAM, margins, and useful lifetime of the system.

embedding-shape 3 minutes ago|||
> An $8k increase making a difference, when you’re wholly dependent on the frontier (or near frontier) lab not releasing a model that makes your work(station) irrelevant

Hmm, why? I don't understand why better models being available remotely would change the usefulness of what you already have working locally? If it works for you, it works, regardless of what the frontier labs have, and if it doesn't, it doesn't, again regardless.

dannyw 57 minutes ago|||
This is a link to their configurable workstation on consumer boards. They offer TR or Xeon based boards too; it's just a different link/SKU: https://system76.com/desktops/thelio-major

So they offer both options.

cherioo 8 hours ago||
This makes Mac Studio with 256GB memory look cheap in comparison. More memory to store weight at a quarter of the price!
colordrops 8 hours ago|
It's gonna have WAY faster token rates than that Mac Studio though, enough to be a qualitative rather than quantitative difference.
GeekyBear 6 hours ago|||
At that price, it's competing against a cluster of M5 Mac Studios, which we don't have test data for yet.
b112 8 hours ago|||
Can't it be both?

EG As I gazed at Janice, joy with equal part contentment washed through my soul.

thom 8 hours ago||
I remember losing sleep when I bought my RTX Pro 6000, but somehow they keep going up in price, and waddya know I’ve even done real work that appreciates the VRAM size.
embedding-shape 2 minutes ago|
Same. Had to convince the wife, initially aimed to get two of them, ended up with one. Now my wife is berating me for not convincing her that I should have bought four and then sell two later... Can't win :)
waterTanuki 3 hours ago||
I find it hard to believe any enterprise willing to drop over $40k on a workstation PC would choose `Pop!_OS 24.04 LTS with the COSMIC Desktop Environment` over Ubuntu.
arjie 9 hours ago||
Haha, bloody hell, mate. $17k a pop? I bought these for $8k-ish. That's bonkers to buy this when newer flash models won't fit on this any more. DeepSeek V4 Flash seems the last in its line, and then you have to count on Qwen Next. Seems like a waste honestly.
rrgok 4 hours ago||
Is this just a marketing stunt? From a completely ignorant user, doesn't AI reeuqires high bandwidth ram (like the GPU)? Is really DDR5’s bandwidth enough?
zepearl 4 hours ago|
> 192 GB GPU memory
rrgok 3 hours ago||
How did I miss that? I was still sleeping I guess
LoganDark 8 hours ago|
Is it more powerful than Apple silicon, or why would anyone buy this? Just for Linux?

Oh, it's System76, that's why. Open hardware. Makes sense.

Edit: Also Nvidia

kelvie 5 hours ago||
The prefill rates are way faster on these cards compared to apple silicon, which affects TTFT and therefore usability for a lot of coding tasks, unless you fire and forget most of the time.
numpad0 4 hours ago|||
Mac GPUs supposedly being fastest thing on Earth obsoleting everything NVIDIA is just pure marketing. It was just faster once than some midrange laptop NVIDIA, which conveniently wasn't explicitly marked as different chip sharing the branding with the desktop variant(oof).

The real benefits to going Mac is its quiet and discreet, high wife/CEO acceptance design, and their huge GPU-assignable shared RAM.

If you're okay with your desk being the wing top of a flying airplane, and 3M Peltor or David-Clark is your favorite working time headphone brand anyway, then your build will be faster and cheaper than a maxed out Mac Studio.

LoganDark 3 hours ago||
For me the operating system (and ecosystem in general) is one of the biggest reasons I use a Mac, but the unified memory pool is a benefit too. I am still distraught about the gaming situation though.
wmf 8 hours ago||
It is more powerful than Apple.
LoganDark 8 hours ago||
I wonder why Apple has not really pushed their memory bandwidth numbers. They're starting to catch up to 2020 at this point -- cool, but still struggling to run years-old models. (FLOPS is even further behind by a year or two)

Maybe they're waiting on HBM? Given that they're skipping M6 Max to go straight for M7, I'd assume they're doing a redesign for it.

wmf 7 hours ago||
GDDR has higher latency and much lower capacity. HBM requires an interposer and also has lower capacity. It's not an easy choice. The M7 family will probably double memory bandwidth using LPDDR6.
LoganDark 6 hours ago||
So the MacBooks might get roughly the M5 Ultra's bandwidth in a couple years. Not bad -- my M4 Max is currently stuck in 2016
More comments...