Top
Best
New

Posted by NikZaal 1 hour ago

Claude Code burns ~15–20% of your tokens on a 3-word status line(gist.github.com)
123 points | 23 comments
HeavenFox 31 minutes ago|
If they are literally sending the entire transcript and asking for a summary, wouldn't almost all of the tokens be cache hit, and therefore fairly cheap?
minraws 19 minutes ago||
I don't want to sound rude but even at cache hit you are burning almost input * 0.10 * context amount of tokens multiple times.

If it happens 10 times you have already accepted the same cost as the entire session fresh prefill.

People on HN are either too rich or wayyy too rich

simianwords 14 minutes ago||
Isn’t it 0.2?
minraws 2 minutes ago||
It's 0.1 I think brain fart I typed the rest correctly though after 10 summaries you still burn the same amount of tokens
buzer 12 minutes ago|||
Didn't they change the cache TTL to 5 minutes earlier this year? So depending on exact timing it could potentially be invalidated between the updates.
dietr1ch 26 minutes ago||
Unless they prepend something like, "summarise this, "
NewsaHackO 20 minutes ago||
But they definitely wouldn’t do that.
jakozaur 7 minutes ago||
I tested it, and it looks real but more nuanced. It is just for subagents; workflows do not seem affected. I guess many new users prefer workflows (ultracode), so the impact is less than the report suggested.

Moreover it is mostly cached reads, so subagents with short context cost little, while long-context ones cost much more.

In my Claude Code sessions, it looks more like ~8% at most.

gym 28 minutes ago||
I was surprised the usage issue wasn't mentioned here before this based on my searching on hn.algolia.

I'm on pro. Two days ago, 100% 5 hour was using 25% of my weekly. Today, 100% 5 hour is like 13% so something was fixed.

bombcar 20 minutes ago||
They very aggressively compact when the cache is about to expire, which saves a ton of tokens, the equivalent of doing a handoff at 25% or less.
adastra22 19 minutes ago||
I assume that is only if compact is turned on? I never use compaction.
OsrsNeedsf2P 25 minutes ago||
This is an A/B test
grim_io 22 minutes ago||
More likely it depends on the overall load of the infrastructure.
creamyhorror 16 minutes ago||
Background agents only have 5 minutes' cache TTL, but I'm guessing this doesn't help extend it (not that it would be too useful anyway, especially considering the extra burn).

Also, the claim "15-20% of your tokens" seems unclear; of all tokens, or of tokens spent on background agents? Poorly edited AI writing strikes again!

apt-apt-apt-apt 24 minutes ago||
At least they seem to have fixed their free-revenue feature-bug, where they randomly invalidate your cache (~$8 a pop (turn))
lifeisloving 19 minutes ago|
This is by design, its the same reason inference providers on Openrouter will advertise super cheap pricing but cache TTLs of 2 min/ 70% hit rate.

Cache rules everything around me.

messh 39 minutes ago||
Bloat. I like Pi much better with it's minimalism
fractorial 5 minutes ago|
As someone who rolled and daily drives a harness leaner than Pi, there’s still a use case for both.

Similarly to “one language is best,” saying “one harness is best” is shortsighted in the best possible case.

That being said, Claude Code is bloatware.

quantbuilder 35 minutes ago||
i think its not the status line at the bottom of the terminal, but actually the few words summary claude generates for each background agents in the agents panel. so if we mostly run one plain session we wont pay for this? i do run claude code with disableAgentView on in my settings. does anyone know if that helps to stop the summary calls or just hides the panel?
simianwords 17 minutes ago||
Isn’t this prompt cached? Then it’s not that big of a deal
helsinki 33 minutes ago||
I’m sure they release a decision model that alleviates this problem in due time.
rsalus 36 minutes ago|
does this happen for Claude Desktop too?
More comments...