Top
Best
New

Posted by matthiaswh 8 hours ago

Ensu – Ente’s Local LLM app(ente.com)
289 points | 131 commentspage 2
jasongill 5 hours ago|
I love Ente Auth, but Ente (as a company/organization) does a somewhat poor job of calling out their non-photos apps in their branding and on their website. If you go to the "Download" button at the top of the page on this page about their LLM chat app, it downloads... their photo sharing application. If you click Sign Up, it takes you to a signup page with the browser title "Ente Photos" but the page text says "Private backups for your memories" with a picture of a lock - is that the Ente Auth signup, or the Ente Photos app signup?

A little bit of cleanup on their site to break out "Ente, our original photo sharing app" from the rest of their apps would do wonders, because I had to search around on the announcement to find the download for this app, which feels about like trying to find the popular Ente Auth app on their website

cromka 1 hour ago|
This is one of the reason I, as their user, am moving away. Things feel half-baked and I stopped trusting it with my data. I self host and the details for this were all over the place. Some of my contributions cleaning up the docs were rejected, so I grew even more wary. I am moving to Immich, even though I'd prefer e2ee for my photos even if I self host them.

EDIT: and there are long-standing bugs like this one, unaddressed: https://github.com/ente-io/ente/issues/3087

lone-cloud 5 hours ago||
Any half capable engineer can vibe code this in a week. Who cares?
H8crilA 5 hours ago||
Someone still has to.
alterom 2 hours ago||
>Any half capable engineer can vibe code this in a week. Who cares?

The people who got tired of waiting for "any half capable engineer" to do so.

cdrnsf 6 hours ago||
I like Ente, but isn't their core product a photos application? Its offshoots like this and 2FA feel incongruous.
alterom 2 hours ago|
Their core product is local ML inference in the context of a photo app, i.e. a drop-in cloud dependency removal/replacement for non-technical, privacy-conscious users as well as those who want advanced functionality offline.

This does the same for language models.

cdrnsf 38 minutes ago||
I hadn’t thought of it that way. Makes sense.
getpokedagain 4 hours ago||
As someone who saw this and was interested but also skeptical of this being low effort are there other open projects for running small models locally on android / iOS?

I've found https://github.com/alichherawalla/off-grid-mobile-ai but haven't tried anything in this space yet.

stressback 2 hours ago|
Google's AI Edge Gallery worked really well for me. It's still in early access.
franze 6 hours ago||
if you are into local LLMs check out apfel

https://github.com/Arthur-Ficial/apfel

Apple Ai on the command line

echion 6 hours ago||
Looks excellent -- thanks; shame older intel macs don't get it (a lot of those still around)
hmokiguess 6 hours ago||
I've been having fun with this one https://github.com/osaurus-ai/osaurus
selfawareMammal 4 hours ago||
> People called us crazy.

Absolutely no one called them crazy.

emehex 6 hours ago||
There are literally 1000s of these types of apps. Why is this on the Front Page?
alterom 2 hours ago|
1000s?

I'd love to know a few more local LLM apps that are available on Android and iOS and Mac/PC under the same branding that I can point my non-technical friends to as a ChatGPT alternative that works offline (but still has sync across the devices).

Could you recommend a few?

QubridAI 5 hours ago||
This is the most important part of local AI maturing not just better models, but better productization of on-device inference for normal people.
georaa 2 hours ago||
Smart move building on local models. The privacy argument is real but I think the bigger win is latency - no round trip to an API means you can do things like inline suggestions that would feel sluggish over the network.
talking_penguin 6 hours ago|
How is this any different from Ollama plus Open Web UI?
kennywinker 5 hours ago|
None of that runs on an ios or android device.
More comments...