And as these models get better the pace of training is quickly speeding up too.
This doesn't bode particularly well for anthropic/OAI after they go public.
They are banking on the application layer and accumulated business and end user context. They have to quickly make that systems integrated value out weigh the model choice price value in the broader market
Unknown if they will be able to pull that off.
with time, it became commoditized, people now have unlimited plans, and the money is made by the applications that sit on top (token generation is increasingly undifferentiated low-level infra)
This is not to say there has not been significant innovation in the time since, but it's a low margin business (tokens look to be headed this way)
https://artificialanalysis.ai/models/mimo-v2-6-pro#intellige...
That's pretty fast; I think I'll try it: https://openrouter.ai/xiaomi/mimo-v2.6-flash
One concern I have is that they allegedly do not discount cached tokens: https://www.reddit.com/r/opencodeCLI/comments/1t37dz3/xiaomi...
Can anyone comment?