Top
Best
New

Posted by sidnarsipur 1 day ago

The path to ubiquitous AI (17k tokens/sec)(taalas.com)
764 points | 419 commentspage 11
servercobra 1 day ago|
I don't know why, but my ultra wide monitor absolutely hates that site. The whole screen is flickering trying to deal with the annoying background. Thank the gods for reader mode.
trippyballs 5 hours ago||
holy fuck this is really gud. imagine this with sota models. we are cooked af.damn
moralestapia 1 day ago||
Wow, this is great.

To the authors: do not self-deprecate your work. It is true this is not a frontier model (anymore) but the tech you've built is truly impressive. Very few hardware startups have a v1 as good as this one!

Also, for many tasks I can think of, you don't really need the best of the best of the best, cheap and instant inference is a major selling point in itself.

PrimaryExplorer 1 day ago||
this is absolutely mindblowing speed. imagine this with opus or 5.2
raincole 1 day ago||
It's crazily fast. But 8B model is pretty much useless.

Anyway VCs will dump money onto them, and we'll see if the approach can scale to bigger models soon.

CrzyLngPwd 17 hours ago||
The demo is dogshit: https://chatjimmy.ai/

I asked it some basic questions and it fudged it like it was chatgpt 1.0

brcmthrowaway 18 hours ago||
What happened to Beff Jezos AI Chip?
big-chungus4 1 day ago||
write six seven as a number

> The number "six" is actually a noun, not a number. However, I assume you're asking to write the number 7 as a numeral, which is: 7

DeathArrow 20 hours ago||
Is amazingly fast but since the model is quantized and pretty limited, I don't know what it is useful for.
notenlish 1 day ago|
Impressive stuff.
More comments...