Posted by speckx 1 day ago
They might be 20% of the price (because they don't have to invest that much in training), but are probably not 20% of the resources (ie. inference), considering they take more tokens to do the same task, and have slower inference speeds.
A Rolex Daytona today is known as a very fancy and even hard-to-get watch. In the 70s they were practically giving them away with other watch purchases because electronic watches were taking their lunch.
The bigger takeaway, I think, is the destruction and folding eventually lead to the Swatch group. People forget Rolex, Omega, et. al. were tool watches that were expensive but fairly attainable. Even into the 90s you could walk into a Rolex store and walk out with the watch you wanted. Nowadays you basically have to buy a watch to prove you're good enough to get the one you want.
I forsee a similar thing happening with computing hardware. There will be a small high-end side industry for non-datacenter customers.
The digital watch user will be renting time for a thin client via a datacenter provider. The wealthy or high status user will be able to purchase the expensive boutique home computing hardware they want.
The only reason you have those watch brands to mention is because they are non-functional status symbols. People that want a watch buy something else.
The same way, people that want a computer will buy from whoever is actually selling them. Manufacturers that want to sell only to datacenters won't last for long.
even if volume and hype decreases from the general pop there doesn't seem to be much of a cap on model requirements -- so at least one sector will be pushed into purchases one way or another.
It’s brutal. I’ve just built a workstation with DDR4 and two-gen old cpu. I paid more for the ddr4 than it originally cost, four years ago. The same amount of ram for the latest motherboard would have been 10x ($10,000). So used DDR4 has gone through the roof, which impacts hobbyists who used to rely on “hand-me-downs”.
My high-end HEDT would now be +$2300 to build mostly due to memory and SSD pricing. 96GB of memory going from $430 -> $1800 is wild. One community member literally wouldn’t be able to buy their Mac Mini configuration anymore, plus the self-upgrade SSD would be price hiked.
Where I blanche most is my storage server running TrueNAS. Built it 3.5 years ago, future-proofing in mind. Strong SSD cache layer, plus two spare HDDs as spares. It wasn’t cheap then, but I think between disks, storage, ECC memory, etc. it’s +$7000 now to rebuild it again, +$9000-$10000 on last generation hardware.
On modern systems (all 64 bit AMD, and Intel Core "i" onwards, so quite old now) the memory controller is integrated into the CPU, so what the CPU supports is what you get, and the latest CPUs are DDR5 only. Intel did have a transitional phase of CPUs that can do both DDR4 or 5 depending on motherboard, but AMD it's AM4 = DDR4, AM5 = DDR5.