What about Sonnet? Haiku? Does it need Opus specifically?
rickypp 4 hours ago|
Seems to me that the important factor is that Jev has well-calibrated confidence for this task. Which secondary expensive model it defers to is probably less critical in this technique as long as that model has higher performance than Jev.
couldaidothis 3 hours ago||
Yeah exactly - very interesting that Luna is calibrated so poorly despite working better on easier problems.
phendrenad2 3 hours ago||
Jev is interesting because it adds "muscle memory" to LLMs. I think we're approaching some fusion of systems that approaches the human brain here.
asar 3 hours ago||
i'm so numb to these headlines nowadays... i guess i've been disappointed by how effective these approaches end up being for actual work but i feel like it's easy to produce these headlines with "proof" that doesnt prove anything besides the sandboxed scenario it was run in