Posted by 1potato 1 day ago
These old workstation platforms seem to be perfectly fine for hosting GPUs for local llms.
My $20 xeons 2696v2 and 2670 are tool old for real offloading, and sata ssd drives are likely a bit slow for ssd streaming :)
CXMT is planning expansion for the ram capacity, they’ll do that faster than the west, I beleive they said end of year ish? (Could be wrong).
once it comes online and they increase their yields, this whole thing changes.
Also new datacenters mean increased supply so cheaper tokens now that parameter size is a non-sequitor.
I’m legit curious how long China holds back… but I doubt it’ll be long.
Could totally be one of those situations where the current cartel outsource all their production for MoW outside the US to them and then just pocket the investment money lol
However … without the US datacenter buildout ramping continuously … the ram will eventually make its way from warehouses to the market lol. We really need a way to use server dram in consumer boards… but idk if that will happen.
Although it would take a ton of engineering and probably a new chip … a custom motherboard would that did that would be legit haha :) would solve a lot of issues.
And I can already see the shitwank bean counters salivating over this prospect. Imagine the possibilities, we can stuff as much DRM as we want, charge as much as possible monthly, arbitrarily restrict the terms of usage in the future. What will the user do? Run the same heavy duty software on their Intel N150 + 4GB RAM shitbox? Blah.
LPDDR5 is slower but maybe a small cluster could be useful?
30 refineries were closed in Europe in the past 15 years about, and that is just a small example of a pathological situation.
Cost of hiring an oil tanker has ballooned massively (like 40 fold) since America decided to bomb its supply chain, so these long supply chains are massively expensive.
The Republican Party has decided that running a world of global free trade was no longer desired. America wont pay the price for another decade or two, but it will.
Europe can easily be more dominant than the Americans if we chose it.
I think in a few hundred years we'll have learnt what a disgusting, poisonous system it is.
Among the many other things they won't have is an economic model.
As you like … but blaming capitalism is not going to bring industry back, and it won't stop China from using slave labour or India from using their rivers as landfills.
The amount of waste produced due to phones not receiving new batteries and software updates was utterly insane, given what goes into making them.
It's terrible if you're a labourer in India who buys phones under 10k INR (~100 USD) when your salary is 20k INR per month.
Unfortunately there are way more in the latter category than the former, and most of them won't know what ram is. They'll just be paying more and getting less going forward for a few years.
(Source, the salaries and phones I've seen of the staff at office. And we're in a major region you've likely heard of, not some tiny rural village.)
That too sounds like an actually good development all things considered. For the planet, anyway. And with the big caveat of that cloud tether, though just for scaffolding.
It would be good if we would use less resources.
But we are not.
It's just that some people don't get the newer resources.
and if it is for your child, read them books.