Would I be surprised there’s bench maxing happening? Yes. But some users also use Q4 quantized and complain how dumb local models are.

All this performance at such small model sizes, why are the API fees so high for the AI monopolists on this side of the world?

I'm wondering whether any provider can offer this for cheaper $/token than the new DSv4 Flash, which is both cheaper and smarter :/

Completely local use is a different story, of course.

Man what a week, We just had GLM 5.3 that came out and then we had smaller local model Qwen3.8-27B from Qwen

Just tried using Pi Agent and looks very promising

Does anyone have a https://tenstorrent.com/hardware/cards to try it on?

Really excited to see what people do with this. 3.7 27B was probably the best compromise between size and intelligence to run on consumer hardware

I wish this can run directly on my RTX 4090, seems like 30B is the sweet spot for dense model to run locally, sadly RTX 5090 is very expensive and I need a new PC and new power supply(and UPS) to run that, adding a second RTX 4090 is another option, but not sure if my PC can do that yet.

Need to upgrade to a second 3090! Slowly building up my local models with Krea2, MiniMax H3 (and their new Music3), and now Qwen 3.8