Top
Best
New

Posted by matthieu_bl 2 hours ago

Once Claude can measure something, it can make it faster(claude.dev)
113 points | 70 comments
smy20011 1 hour ago|
The way Claude did it is fight entropy with entropy.

"Add a static composer into the HTML" <- This seems like something can be done with SSR?

"For faster navigations, we kept the composer mounted between conversations" <- Your SPA should cache this between pages, why fetching it every time? Or you need better routing for your react components.

"cheap first-character check before the regex" <- Should we cache compiled Regex instead?

I think even 1.3 sec to load the front page is unacceptable. Something need to be reworked from basics (SSR, chunk-based rendering) to solve the problem. Focusing on invidual benchmarks may miss the opportunity.

rustystump 1 hour ago|
The amount of complexity added for the gains is depressing. I am confident a human and about 5 minutes with chrome debugger would yield better results with a fraction of the complexity at a fraction if the cost and in a fraction of the claude baby sitting time.

Reading this shows the authors have a profound lack of fundamental understanding on how to effectively optimize in the web domain.

This isnt claude being bad but how wild it is watch people from the cutting edge of ai brag about pretty mediocre gains.

adamddev1 52 minutes ago||
When people talk about AI being able to handle everything I keep wondering, have these people built anything complex, novel or serious? Just because people can see a website or a simple app improved, does that mean that all code can be handled by LLMs? It's like people are totally forgetting a whole category of careful, well-thought out programming for the critical parts.
whatisthiseven 26 minutes ago||
Yes, what you are seeing are amateur developers that barely understand the tools they are using either giving LLMs poor instructions, or totally taking whatever it says at face value, then not bothering to put in further effort.

If they just kept prompting it, or maybe used a different thinking level, it could have identified and solved this problem. Sometimes an engineer would look at a system and say "the current approach isn't delivering the desired engineering requirements. Maybe we need to rethink".

Either engineer or LLM could take that sentence and run with it. OP of the article clearly can't do either.

theolivenbaum 16 minutes ago||
You're missing the point where: in complex systems, sometimes optimizing code is both a high effort undertaking, and can totally not pay off. Having done hundreds of such exercises on our software over the years, it's liberating to have an idea of how to make something faster, being able to validate it without the fear of having to throw it all in the trash if it fails after days of work. What is still important is being able to provide proper guidance - we even built new tools to allow an AI agent to analyze memory usage in more depth, and instructions on how to benchmark in cloud environments where shared CPU usage and VM reallocation happen all the time and confuses the AI all the time with measurements
simonw 47 minutes ago||
I visited https://claude.ai/ over a mobile tethered connection from my laptop the other day and was pleasantly surprised at how quickly it loaded.

(That said, I just had a look in Firefox and it loads 20.78 MB of JavaScript (6.84 MB compressed) so I expect they could make it a bunch lighter if they kept trying.)

hungryhobbit 1 hour ago||
How about you make Opus 5.5 actually work?

I had it try to prepare a code review for me. Not only did it refuse, it refused to even tell me what the prompt (written by another Claude!) was. Why?

When I had another model read the session (all of the "stupider" models handled it just fine) it explained that it had the word "reasoning" in it

That's the entirety of Anthropic's billions of dollars of research: any prompt with the word "reasoning" is trying to hack Claude to figure out how it reasons!

A model like that should never have gotten out of QA, let alone been released.

bitpush 1 hour ago||
I understand the frustration but shows a lack of critical thinking. Esp when you start with 'How about ..'.

This blogpost is about frontend performance. It'll be akin to you commenting on a swift blogpost saying 'How about Airpods noise cancellation'. Sure both are Apple, but they are wildly different teams.

hungryhobbit 1 hour ago||
This is a techie discussion forum.

In such a forum, it seems to me like it's fair game to point out that the company patting itself on the back about how great they are at programming (as evidenced in the article above about their 3x speed improvement) ...

... can't even make their latest model handle basic English without refusing to work.

jfidjcjwjcjwjd 19 minutes ago|||
Not that I’m defending Anthropic but OP is right, you’re complaining about the taste of a pear on a blog post about roses with the excuse that you’re in a biology forum. Sure, they both come from the same family, and sure, they both fall under the purview of biology, but they’re not the same.
dolmen 56 minutes ago|||
This issue is mentioned on the Opus 5.5 post [1] from Anthropic (no idea if it has been added after your rant):

  > Don’t ask it to show its reasoning in the reply
  >
  > What to do. Remove requests to reproduce its internal reasoning in the reply from your prompts and instructions.
  >
  > Why it matters on Opus 5.5. A request to reproduce its internal reasoning in the reply can be declined. It’s one of the flag categories.
  >
  > How. Ask Claude for what you need instead, for example, “Explain why you chose this approach in three sentences.”
[1]: https://claude.dev/blog/getting-the-most-out-of-opus-5-5/
vikramkr 1 hour ago|||
Probably it thinks you're doing some sort of system prompt exfiltration/distillation attack. Also what even is the workflow you're trying to have it do? It's doing code review but you're having it read some other AI models prompt/session history? Are you doing code review or like session history retrospectives?
post-it 1 hour ago|||
> When I had another model read the session (all of the "stupider" models handled it just fine) it explained that it had the word "reasoning" in it

Did it explain it did it hallucinate?

hungryhobbit 1 hour ago||
This happened at the classifier level, there was no "Claude thought X about it (hallucinating or otherwise)": this was a glorified regex deciding Claude couldn't work on a prompt (a code review prep) because it contained a string ("reasoning") it didn't like.

It's more or less the same mistake we've seen Anthropic make repeatedly with it's brain-dead regex-based Fable/Mythos gates.

post-it 51 minutes ago||
> because it contained a string ("reasoning") it didn't like.

How do you know? How would the stupider model know?

nfcampos 24 minutes ago||
Because it’s in a page accessible from its search tool presumably https://claude.dev/blog/getting-the-most-out-of-opus-5-5/
railgunmerlin 1 hour ago|||
seems a bit weird to complain about the model issues in a post about the harness/sites?
frumplestlatz 1 hour ago|||
I’ve had the same thing occur five or six times over the past week; they seem to be attempting to prevent anything resembling chain of thought extraction.

Every single time it triggered, it was due to a prompt written by their own model in a dynamic workflow. The self-serving nanny oversight has to go.

The fact that they label model distillation as an “attack” is genuinely hilarious after they “distilled“ their models from all of our work, and continue to do so.

I believe AI is here to stay and an incredibly powerful tool, but these companies, and especially Dario and Altman, are the very last people I want to see in charge of it.

copperx 1 hour ago||
> “distilled“ their models from all of our work

They distilled all digitized human knowledge and artifacts and they're now complaining about someone copying their outputs saying it's a "national security concern."

I'm not sure about how to classify that. Hilarious? Pathetic? Sad? Hypocritical? Hyperdramatic? All of the above?

Marciplan 1 hour ago||
[flagged]
hungryhobbit 1 hour ago|||
Again, I used a slightly older model in the same series, Opus 4.6. It read the same prompt without any problem whatsoever. Also, a (non-Opus 5.5) Claude wrote the prompt in the first place.

Opus 5.5 literally refused to work OR EVEN TELL ME WHAT I'D "SAID" when it read that prompt.

Nothing to do with skill or the user at all: same exact prompt, three different models ... two worked, one didn't.

cyanydeez 1 hour ago|||
the skill issue is "having to use a cloud model to do work of any value"

might as well offer your life to a king to work in their fields.

pllbnk 1 hour ago||
> $500k engineer: [X] feels slow. Make it faster.

> Claude: On it... Done.

> $500k: Can you make it faster still?

> Claude: On it...

hmokiguess 1 hour ago||
You removed the load-bearing seams didn't you
altern8 1 hour ago||
I used Opus 5.5 today for the first time hoping the writing would be more bearable and it SUCKS.

Why can't they fix that

tarr11 1 hour ago|
Opus 5.5 writing is much more concise than 5.0
m00x 1 hour ago|||
but Opus 5 is absolutely terrible. I'm still on 4.8 when I use Claude. I still think 5.6 Sol is the best available model outside of Astra/Fable.
altern8 1 hour ago|||
MAYBE, but the bar is so low... It's not that it's good in any way
whythismatters 1 hour ago||
The juvenile nonchalance with which some Anthropic employees seem to be talking to their AI (wacky, sick, cook, ...) is truly bizarre.
kylecazar 13 minutes ago||
"You know what we want. Let’s go"

It doesn't seem like a big deal at all on the surface, but I do start wondering why someone who presumably knows how these models work would engage like that

ieie3366 1 hour ago||
That’s just how people in their 20s casually communicate now. It’s mostly from tiktok
minimaxir 2 hours ago||
This writeup legit coincidentally matches the asking-agents-to-make-code-faster-but-with-constraints-to-stop-agents-from-breaking-things writeup I posted on Monday: https://news.ycombinator.com/item?id=49803085

Front-end UI optimization is slightly trickier than optimizing strict algorithms, but I found that prompts to the agents to build tooling to track visual regressions are more than sufficient. The main issue (at least with GPT models) is that you have to be very explicit about the use of padding/margins/negative space.

That said, for my front end projects from scratch, I'm staying away from front-end JS frameworks and seeing how far and fast I can get with just HTML/CSS/vanilla JS shenanigans now that agents can wield them effectively.

vikramkr 1 hour ago||
Less a post about performance and more about their Claude tag product. I guess it makes sense that there's not actually a ton of technical detail being moved into given probably opus is the only one that knows what all the dragons were lol - but cool workflow I guess
devin 32 minutes ago|
I dare you to try and get heavy CPU cache-level performance optimizations you might see in tried and true HFT code written this way.
More comments...