Does "Apple Intelligence" need to be Turned On for this as well?

So many people have Apple a hard time for not focusing enough on ai.

Seems that the UX will be enough to win over users and investors

Shared daemon is the only way this makes sense on-device. A 3B model at 4-bit is roughly 2GB - three apps loading their own copies would eat an 8GB phone.

> A key bundled into an app is extractable from the shipping binary, and anyone who extracts it can make requests billed to your account. Use .apiKey for development only, and switch to a proxy before release.

I don't like this model. Then all the user data is visible to the proxy.

Far better would be some kind of micro payment architecture where a wallet is on the users device and coins are attached to each request.

We just need to live in the alternate universe where micro payments succeeded.

Since Claude is technically a subscription, Apple will slowly weasel their way into skimming 30% of the token spend

So where does the api key reside? You can’t ship it on the iOS client since anyone can read and abuse it

I didn’t understand what they were doing with Apple Foundation Models until this. It made it sound like they were training their own. Good strat tho!

Can someone explain me what it means in the context of Apple and ChatGPT/Claude/Mistral...?