Top
Best
New

Posted by LabsLucas 5 hours ago

AMD Ryzen AI Halo – $4k AI Dev Kit(www.lttlabs.com)
170 points | 140 commentspage 3
syntaxing 4 hours ago|
I have another strix halo that I got for half the price (before this price increase world wide). AMD making lemonade is one of the best reasons to get a strix halo. Lemonade + qwen3.6 35B MTP @ Q8_0 + anythingLLM (in docker) replaced 90%+ of my AI usage. And it’s fully local! Setting everything up took less than 3 hours total, including installing the OS

https://lemonade-server.ai/

onraglanroad 1 hour ago||
I think I might be tempted to wait for the Butlerian market crash and pick up stuff from the firesale.

Depends how long this market can remain utterly loony though.

PHr15 4 hours ago||
Even a two-year-old Mac Studio outperforms this kit. A used unit with sufficient memory currently seems to offer the best price-to-performance ratio

"The Apple Silicon Mac Studios outperform the AMD Ryzen AI Max+ 395 machines"

Grombobulous 2 hours ago||
I imagine there may be users who can’t use macOS, or maybe they want the ability to upgrade storage.

The framework desktop even has a usable PCIe 4x slot available if you put the board in a different case. They sell the 128GB board on its own for $3150.

LabsLucas 2 hours ago|||
Comically, the 512 GB M3 Ultra Mac Studio that we tested isn't even available for purchase any more. The highest you can purchase from Apple is 96 GB.
bronson 2 hours ago|||
And how much can you buy a 128GB Mac Studio for now? Go look. I think you'll be shocked.
jeffbee 4 hours ago||
A 2-year-old Mac Studio 128GB also sells for more.
daft_pink 4 hours ago||
It would be really nice if they included clustering support like a blueprint on how to buy several of these and cluster them to run the really large models in the best way possible.
glimshe 4 hours ago||
How much are we going to pay for "AI kits" once the DRAM shortage is over? Will we be able to run a local model equivalent to the current AI frontier in sub $1000 hardware, even if dedicated, in 5 years?
url00 4 hours ago||
Yeeeeep. There is no moat at the moment. AI companies are trying to dig one as fast as they possibly can. Either through passing laws to prevent local inference ("It's too dangerous! We need to control it") or by creating/limiting possible integrations (locking down OS/hardware, APIs/MCPs that only work with Claude/ChatGPT, etc).
yomismoaqui 4 hours ago||
Good luck trying to enforce those laws outside of the USA. And in the future China will be happy to sell local inference hardware at competitive prices.

Open, cheap & good enough will win the race.

moelf 4 hours ago|||
frontier to laptop runnable open weight so far seems to be ~2 years latency, so maybe there's some hope
tracker1 3 hours ago||
For that matter, just getting Chinese DRAM into the market could cool pricing down a lot to oppose the cartel.
wmf 3 hours ago||
No it won't because Chinese DRAM manufacturers have relatively low capacity and it's already being used. And in an auction, prices from different suppliers converge.
tracker1 46 minutes ago||
Because China can't ramp up production at all... no means to do so... they aren't even working on it at all.
tracker1 3 hours ago||
When this hardware was announced, it was expected to be in the $1200-1400 range new... so, maybe. The real question is will the powers that be let this bubble burst, and how painful will the fallout be... I have a feeling it will be worse than 2001-2002.
snarfy 3 hours ago||
I want to play with openclaw for continuous workflows without burning my cloud credits. Do I want this?
jdiaz97 3 hours ago|
no, you openclaw is too vibecoded, use Hermes
musha68k 4 hours ago||
I had hoped this was about Medusa Halo, but unfortunately, it's about 2025 technology. It's the same as Framework Desktop was at the end of last summer, which would have been a slightly silly but fun buy at $2k... I'd hope Mark Cerny / Sony launch PS6 sooner rather than later, as together with the upcoming LPDDR6 standard, it should trickle down to us in the local LLM mud eventually?
re-thc 4 hours ago|
> I hope Mark Cerny launches his PS6 sooner rather than later

With the current RAM and SSD prices... I rather a bit later.

musha68k 4 hours ago||
True, this is the new reality though. My main gripe with Strix Halo is memory bandwidth and compute performance. Gaming performance sits squarely in base PS5 territory just as is the case with Steam Machine AFAIR; yet due to economies of scale "cheap" 2020 era PS5 still has higher memory bandwidth by quite a bit last time I checked.

PS6 "undertaker of physical media" will supposedly be priced >$1k: https://youtu.be/-F1JS-4Abjo

khurs 4 hours ago||
Are the likes of Dell and Lenovo not going to be annoyed that AMD are cutting them out?

As traditionally AMD was a supplier of parts.

tracker1 3 hours ago||
Both Dell and Lenovo have tended to favor Intel first... even more recently on business laptops.
benoau 4 hours ago||
Do they care that Microsoft is selling the Surface, or that Intel used to sell the NUC?
khurs 4 hours ago||
Intel = Fair as they sell both Intel and AMD so no loyalty on either side.

Microsoft = yes, they care enormously, as Surface has taken away many sales. Albeit they sold some ChromeBooks

danielrmay 4 hours ago||
Perhaps if less spending went towards their private aviation interests LTT labs could review a piece of hardware that was released _this_ year, or maybe extend their narrow testing process to cover real-world use metrics like TTFT. Not to mention the lack of real value-perf comparison to CUDA
Mogzol 38 minutes ago|
This hardware was just released this week? The CPU is from last year, but this dev kit is brand new.
danielrmay 20 minutes ago||
Can you explain which benchmarking differences you'd expect to see from this hardware, considering?
Mogzol 3 minutes ago||
None evidently. Why does that matter? I was just pointing out that this hardware was released _this_ year.
alexdns 4 hours ago|
Bosgame is $2799 does the same thing if you plan to run only 1 of them
mhitza 4 hours ago|
The repeated claim that all these different forms are not directly comparable is a very strange aspect.

Only thing that separates them is the build quality and the extra 20W of boost the framework desktop and this variant support.

They have a note on the thermals but no measurement of noise. Doesn't matter if it's stricly a whoosh or a whine, only if they bother people in the same room. And the small ones like Bosgame get a consistent complaint about the noise in in-depth youtube videos.

alexdns 1 hour ago||
The framework has a noisy PSU , the bosgame is noisy However you can fix both - the bosgame leaves you a large margin to do so
More comments...