Top
Best
New

Posted by tosh 15 hours ago

Small Models Have Arrived(calv.info)
578 points | 263 commentspage 3
Kim_Bruning 3 hours ago|
It's kinda fun that people get to experience what the 8-bit era was like!
caust1c 14 hours ago||
IMO big models are not a product in and of themselves. Inference is just a new type of compute. I'm confident that in two or three years, every product will have inference capabilities integrated into the experience, and models will become less and less distinctive from one another.

What most products need from a model is a pretty short list: the ability to make tool calls well, accurate recall, and the ability to follow directions without wavering (whether or not those directions are baked into the weights or provided in a system prompt). That covers 95% of inference utility in products.

We're nearly there, and I believe these capabilities will fit on small models.

Because of this though, I predict hardware demand will stay high despite demand for "hosted" inference dropping. Unless there's some regulatory shenanigans that step in to say otherwise.

highfrequency 13 hours ago||
> the "token spewer" work. being ultra responsive, pushing the ball forward across dozens of different fronts... ~95% of the work he does falls into bucket 2. It's hopping on calls. Nudging people. Blocking and tackling.

This is a good insight broadly!

nullbio 9 hours ago||
The future is self-hosted models trained on your own reasoning traces autonomously, as you sleep, using QLoRA and whatever else.
low_tech_punk 13 hours ago||
The tokens per second speed measurement is highly inflated nowadays because most of the tokens went into thinking. I wonder if there is a more realistic measurement for "effective speed", which accounts for thinking efficiency.
ak_t 13 hours ago|
Many benchmarks now measure the total cost or energy usage per completed task.
wxw 14 hours ago||
100% agreed. Small, cheap, and hosted models. Luna (and open weight models and others) is ridiculously cheap @ $0.2/$1.2, easily accessible, and more than good enough for basic use cases (e.g. summarization, simple tool calling, etc.).
marius_ 10 hours ago|
I wouldn't call $0.2/$1.2 "ridiculously cheap"
embedding-shape 12 hours ago||
I love how "Small Models" apparently is "Model of unknown size but probably smaller than another model that we also don't know the size of".
oybng 11 hours ago||
An absolutely nothing post at #2 on the frontpage
zatkin 14 hours ago||
Maybe I'm being super reductive here, but operating small models at the core of your business kind of moves the needle from making external API calls (against frontier models) to running internal API calls (against your locally-run models). It seems like if we want local models to take off, it will need to become easier to run local models for cheap. I'm thinking like reducing the barrier of entry for running "local models" in the cloud providers like DigitalOcean, AWS, etc.
malfist 14 hours ago||
You should be glad to know digital ocean already offers this
regularfry 10 hours ago||
In theory so does AWS, but the Bedrock model selection is badly in need of a refresh.
spl757 13 hours ago||
I only run local models and I don't give them access to much externally. I don't do anything serious with it, but it comes in handy and I know that they can do so much more. I'm on a meager RTX 3060 12GB and a GTX 1660 Ti with 6GB for some extra vram space. When I first started playing with local models, I was really impressed with what I was able to achieve locally.

That's great, but the thing that worries me is that many companies have billions invested in the AI bubble. It's around 1.5 trillion last time I looked. It's all circular spending between the companies building out the infrastructure, and the models. None of it is profitable. They will want to recoup that 1.5 trillion from consumers, which means using online-only pay-as-you-go cloud models. They will inevitably see that people using capable local AI are "lost customers" and they will try to kill the ability to locally host AI or somehow enshitify it enough to make paying a subscription more palatable.

I'm not saying I believe that will happen, I'm just worried that it will. Is anyone else worried about that as well?

mumbo_rmj 4 hours ago|||
My money would be on ‘for security purposes we just can’t let these get into the wrong hands’ and then the lobbyist go to work.
mlnj 13 hours ago|||
I am very excited that more makers will come up with fast memory for consumers rather than enterprise. Companies can only pre order so much RAM.

At some point there will be a surplus of fast memory and even in a crash the current generation of SLMs are bounced to be plenty to build a lot of intelligence at home.

1saadcodes 8 hours ago|
The cost difference is pretty dang nice. Going from roughly a dollar to $0.10 for the same kind of task makes it so that products that didn't make financial sense before become possible
More comments...