Posted by tuhtah 8 hours ago
They'll probably wait for summer, the world cup finals, or whatever's last big US government thing is so it flies under the radar.
I have a few more or less idle VMs running at different providers, and keeping an eye on the european VPS market it seems that many struggled, while contabo is relatively stable. E.g. ovh at times limited the buying process to 1 instance (now it is at 5, not sure what was the default before) and also available locations were limited at one point a few weeks back.
And does the standardization mean that I can no longer buy extra hardware?
https://docs.hetzner.com/robot/dedicated-server/dedicated-se...
The machine itself is basically useless for any type of realtime inference, no matter what the marketing page states, but I still use it for prototyping LLM integrations and running comparisons across MoE models.
If only the alternatives to framework desktop wouldn't be so poorly built, I might swap it out for a local machine which has more ram but comparable performance for stuff like gpt-oss-20b (around 70tok/s)
Along with the increase in monthly prices they've dropped setup fees back to more approachable levels, though not as low as they were a year ago. For the GEX44 it was €79 a year ago, now €114. Monthly price was €184 a year ago, now €234.
I told ya about silent happiness…
It's pretty silent happiness over at the Hetzner camp.
A couple of naive questions:
1. What's the bottleneck in ramping up RAM production? Is it the availability of silicon itself? Or the factories are at capacity?
2. Is this supposed to ease up despite the AI boom? Definitely would ease up if busted.
2. Eventually more plants will come on line. Most of the main manufacturers have announced expansions but these can take O(years) to come online.
They sold their allocations to people who don't have a clear path to profitability, and were paid with massive amounts of money that don't exist in reality.
How's that possible?
For a RAM manufacturer, the incentive is to ramp up production AND prices. I doubt any of the names in the business is doing any work at all to lower their unit prices.
Safe to say they're not in it out of sheer altruism.
What's the next best option now?
If not then it is only a matter of time before other providers are forced into similar price hikes.
I mean don't get me wrong, this for sure is a factor but like others said, other services don't see such drastic price hikes.