100% agree on this.

I've been working on small local models for years with txtai (https://github.com/neuml/txtai). I've published close to 100 models that can run local for RAG, Agents, Vector Search and more (https://huggingface.co/NeuML/collections).

SLMs for the rescue!

I looked into this a bit but unfortunately because of starlink most of this won’t be needed

[dead]

[flagged]

[flagged]

[flagged]