Top
Best
New

Posted by itvision 12 hours ago

AMD acquires Taalas to boost inference performance by etching models in silicon(www.theregister.com)
https://ir.amd.com/news-events/press-releases/detail/1296/am...

https://chatjimmy.ai/

587 points | 445 commentspage 4
matheusmoreira 5 hours ago|
> Once the chips are deployed you’re stuck with that model.

At least we can be sure that's the model we wanted. Service providers could be serving modified versions and nobody would ever know.

yunnpp 6 hours ago||
I would've hoped the company stayed independent instead of being engulfed into a behemoth. I'd like to see more diversity in the hardware ecosystem, but I guess the economics of hardware manufacturing aren't there.
ratsbane 4 hours ago||
Smart move by AMD. Chatjimmy is very fast and not very good, but I think it might become very fast AND very good.
3836293648 5 hours ago||
They moved from HBM to dedicated silicon and only got a 48x speed up? That is so, so, so much less than I would've expected. Any numbers on how it scales?
ford 6 hours ago||
I've been showing people chatjimmy for months - it's incredible. Both reasoning and tool use generation scale with TPS. Imagine 100x more reasoning on a model, or 100x parallel tool uses.
yigalirani 2 hours ago||
what prevents amd to just do what they do without acquiring them?
galaxyLogic 7 hours ago||
I think the big news is that AMD is getting into memory-business so they won't be so dependent on Hynix and what have you. Memory is the bottleneck currently.
nolist_policy 1 hour ago|
AMD doesn't even have their own fans.
redmoonx 10 hours ago||
It obviously won’t be continuous delivery but could make sense if the lifecycle of a model (train, deploy, iterate (meaningfully) is about 1-2 years. In that case it fits nicely in the “this year’s model” already established with cars, phones, etc.
rvz 12 hours ago||
Didn't even give them a chance to launch the hardware.
laweijfmvo 9 hours ago|
I’ve been using Gemma as my default (via Kagi) because it’s served on Cerebas hardware. The speed is honestly a game changer for day to day queries.
More comments...