Local AI needs to be the norm

Posted by cylo 1 day ago

1664 points | 653 commentspage 10

RataNova 21 hours ago|

I mostly agree, though I think local AI will need better UX around failure modes. Cloud models are often used not just because developers are lazy, but because they are more capable and easier to support consistently across devices.

cl0ckt0wer 9 hours ago||

If they do then hardware costs will explode even more

osjxjsjxjs 3 hours ago||

No AI needs to be the norm. Again.

krupan 21 hours ago||

Here I was hoping that this was some plea for us to get away from proprietary solutions that we have no control over and go back to open source, but no, not that at all.

rarisma 18 hours ago||

I think with turbo quant forks eventually being merged, its becoming more feasible on mid tier consumer h/w

Dont quite think its ready yet.

karmasimida 15 hours ago||

How? Memory price is sky high, that is the choke hold the monopoly will not let go

TechSquidTV 19 hours ago||

Local AI will catch up. Unless we can't get our hands on hardware anymore, which is a legitimate concern I have.

unnouinceput 4 hours ago||

Quote 1: "We need to return to a habit of building software where our local devices do the work."

Quote 2: "I can only speak on the tooling available within the Apple ecosystem since that’s what I focused initial development efforts on."

Oh, the irony. I will use your tooling when is available on Android with F-droid, that's when, at least, be decoupled from big companies grip.

vegabook 23 hours ago|

>> years ago I launched "The Brutalist Report"

proceeds to brutalise the reader with an 88-point headline font.

More comments...