Posted by kuberwastaken 20 hours ago
Now, perhaps Kimi 3.1 is missing from the benchmarks, and Deepseek 4.1 Flash is still has impressive!
A first step on a trip which will hopefully go quite far.
I think we will not see any significant increase of that numbers in next 4 - 5 years.
Does MoE depth justify itself to be stored and served as "one" model for particular tasks like agentic coding vs same active params non-MoE model?