Posted by acossta 9 hours ago
Future work will extend Minions to support distributed model training in addition to inference
It would be especially useful for RL post training of existing models, which is where much of the agentic abilities arise from.
Look at it like this: a maxed-out M5 Ultra Mac Studio starts at $6,799, and the iGPU benchmarks similar to an $800 RTX 4070 Ti SUPER. That's a 3nm SOC getting outperformed by a 5nm dGPU; Apple Silicon is years behind Nvidia's consumer offerings, and that's before we even compare with datacenter-grade DGX/Instinct GPUs.
It has 6x the RAM, 2x the memory bandwidth and looks like it totally outclasses the RTX 4070 Ti SUPER. I did some searching and it looks like a close comparison would be the older M3 Ultra Mac Studio, although again, with a lot less RAM.
I wished they had a bit more memory bandwidth though, this is quite annoying.
https://arxiv.org/pdf/2610.12970
Shortest promoted paper I've seen from a FAANG.
Building the classification part now :) https://jeffyclassify.com/
Apple has released some small models previously that seemed genuinely great, along with some quality research/efforts. I’m just not seeing the same level of depth here, am I missing something?