Posted by theanonymousone 15 hours ago
[0] https://petergpt.github.io/bullshit-benchmark/viewer/index.v...
Why do the cache hit rates seem to vary so much between harnesses?
I use pi, which is very minimalist, and I get a hit rate of ~99%. Paying like $1 a day for Flash. Yet, the hit rate mentioned on OpenRouter is only ~79%.
BTW, this is one of the things that I really like about Pi. It’s very simple and thus very predictable.
create a plan with SOTA, execute with this.