Posted by shioyama 11 hours ago
I think for HPC there's still a lot of untapped potential for chips like these where you're doing primarily "computation" in the sense of crunching numbers. We're seeing that with GPUs, TPUs and with Tenstorrent. For general purpose applications though Amdahl's law strikes again, and the longest serial task is what ends up slowing everything down. It seems modern CPUs are mainly designed around this bottleneck, which is why imo out of order execution will almost always beat in order execution designs for most day-to-day needs.
One other thing I've been wondering about, what would realtime programming look like on Frostbite? Could you make guarantees in execution time? To be fair realtime is quite tricky on out of order cores, but I'd be curious what mental model you'd use for realtime on something like frostbite, or if serial logic still rules.
When they actually make a CPU and offer it for use, then we'll talk about their magic LLM-designed CPU.