Top
Best
New

Posted by shintoist 13 hours ago

How to stop Claude from saying load-bearing(jola.dev)
414 points | 473 commentspage 5
pugio 13 hours ago|
I wrote a thing about exactly this, but I'm resistant to blogging for undefined reasons so, maybe this will help someone...

# AI speech is an Infohazard

Apart from all its other possible boons and ills, one danger of AI is just that it is useful, so you use it. A lot.

In earlier days I would dive deeply into an author's work and start to think and write like them for a while. It was a heady feeling: slinging sonnets like Shakespeare—not at his level, but stylistically reminiscent—or tweaking turns like Twain.

Like all things, the effect lasts in relation to how long and how much you do it. The point is: our thinking is influenced by what we take in. Take more of a certain thing in, think more like that thing.

Now enter AI. My hand-crafted coding days are in their twilight months ("AI years"), and most of my software engineering is done through jaggedly capable agentic power tools. Instead of working directly with raw codestuff, I work with slop prose flecked with code sprinkles.

I read orders of magnitude more AI-speak—I call it "babble", or perhaps "Babel"—than human-written text. I can feel its genuinely honest points, clearly stated, slipping their banal tendrils into my thoughts and inner monologue.

Solutions? For me:

1. Be aware. "I notice that my thought stream is under assault."

2. Read stuff far from slop. Even a small dose of the good stuff can help inoculate. Recently I thought On the Calculation of Volume was something completely different.

3. Write stuff that is different. This post. Force the mind to synthesize thoughts in other ways.

4. debabel.py / debabel.js: a tool, and a pi extension, which filters common babble from visible LLM output. A lint for mind-killing prose.

It is not perfect, but it 80/20s nicely. I am willing to accept mildly awkward prose to avoid polluting my own internal distributions.

Details and example in the first comment. Tool available upon request.

pugio 13 hours ago|
References:

Information hazard: https://en.wikipedia.org/wiki/Information_hazard

Babel: https://en.wikipedia.org/wiki/Tower_of_Babel

On the Calculation of Volume: https://en.wikipedia.org/wiki/On_the_Calculation_of_Volume

The revenge of NLP

The tool uses good old-fashioned regex/NLP—no LLMs—and rewrites the visible LLM Markdown without touching files on disk. I made it by analysing 10M+ words of past pi transcripts, doing frequency and pattern analysis, and iterating on rules to strip out the most egregious sloperisms. Now the circle is complete.

BEFORE

"Honestly, you're absolutely right—and that's a great question. Let me be clear: the fact that the parser works at all is actually quite remarkable. We utilize the tokenizer in order to handle the majority of edge cases, and due to the fact that it's recursive, it processes a large number of inputs. It's worth noting that this isn't really a bug—it's genuinely a deliberate design choice. In terms of raw throughput, the cache is significantly faster, and I think we should simply ship it.

That said, at the end of the day, not only is the design correct, but it is also fast. In other words, prior to refactoring, we should clearly delve into the nuanced, robust architecture. In conclusion, this is a testament to the seamless, intricate work the team has done."

AFTER

"That's a great question. That the parser works at all is remarkable. We use the tokenizer to handle most edge cases, and because it's recursive, it processes many inputs. This is a deliberate design choice. For raw throughput, the cache is faster, and we should ship it.

Not only is the design correct, but it is also fast. Before refactoring, we should delve into the nuanced, robust architecture. This is a testament to the seamless, intricate work the team has done."

pjc50 13 hours ago|||
I would add https://www.orwellfoundation.com/the-orwell-foundation/orwel...

("It consists in gumming together long strips of words which have already been set in order by someone else, and making the results presentable by sheer humbug" -- Orwell predicts the LLM)

and also https://www.jstor.org/stable/25515288 "The Myles na gCopaleen Catechism of Cliché" itself is rather hard to find online, but he's a very funny writer so it's worth the effort.

lostlogin 13 hours ago||||
> Babel: https://en.wikipedia.org/wiki/Tower_of_Babel

I was hoping for a reference to the Babel Fish, whispering its translations in your ear.

ithkuil 11 hours ago||||
It's not clear to me whether that tool exists or you hallucinated it into existence with this post
iamjackg 9 hours ago|||
I'd love to see that tool.
utilize1808 4 hours ago||
I just use a ban list in CLAUDE.md: fold, crux, invariant, gate. I find "load-bearing" can be load-bearing so it's exempted.
Terretta 3 hours ago|
WTH is a "fold"?

I think Claude means something like map-reduced or at least a functionally derived series of some kind?

Anything with series data sounds like a laundromat.

plebianRube 5 hours ago||
'genuine(ly)' and 'honest(ly)' too.
trefoiled 7 hours ago||
I've spent two hours today trying to provide Sol with guidance that reduces its pretentiousness, to no avail. Layers upon layers of rules only for it to use the phrase "async spline resolution" in a sentence.
mchinen 13 hours ago||
I enjoyed this.

I'm surprised there's no LoRa layer or auto RL or adversarial step to reduce the stock phrases as they pop up. Is it really so hard to push these out? Or is it just whack-a-mole no matter what you do?

Myrmornis 13 hours ago||
I like to think that the reason it's so noticable is that Claude has recognized some important semantics that we ourselves lack a good word for or at least under-appreciate. What term is used in English (or other languages) with the same meaning as claude's "load-bearing"?

operative? key? critical? decisive?

The honest conclusion is that none of those are as good as "load-bearing". And yet the concept being referred to is clearly extremely important and valuable to refer to. So maybe we should be learning from Claude rather than complaining.

Retr0id 13 hours ago||
> The honest conclusion

I think you've been reading too much claude output! "Load bearing" is cromulent verbiage and can be used in many scenarios - so claude does. But variety is important too, and there are more specific alternatives that can be used in most situations. Any word becomes a bad choice if you've used it 10 times in the last chapter.

Myrmornis 12 hours ago||
You don't think me using "honest" there might have been a tiny bit of (on-topic, and therefore appropriate) trolling?
Retr0id 12 hours ago||
Poe's law
bigfishrunning 13 hours ago|||
but you don't see "load bearing" nearly as often in prose written by people, so it's not some irreplaceable phrase. It's just a token with a weirdly high likelihood in a lot of cases (given how Claude works, this kind of thing is bound to happen)
Myrmornis 13 hours ago|||
You don't think it's possible that an LLM's internal machinery could decide that an underused-by-humans word should be used more frequently in output than it sees in input because it maps cleanly onto a frequently needed semantic? I think that's possible
bunderbunder 13 hours ago||
It sounds like you are trying to understand LLM behavior using a mental model that inaccurately personifies the stochastic parrot.

A more parsimonious explanation is that this term got more-or-less randomly boosted by the reinforcement learning loop because there was nothing in the training data to discourage its use.

Myrmornis 12 hours ago||
Ah right, you don't like AI and don't care to understand how it works.
bunderbunder 12 hours ago|||
I’ve been working in AI - and specifically NLP - since 2003. I am no stranger to how weird quirks can sneak into overparametrized models, nor am I a stranger to how good humans can be at inferring meaning where there is none in specific language model behaviors. So, yeah, I am inclined to assume non-teleological causes are more parsimonious than inferring the presence of a strange loop, because that continues to be the winning bet. Even for generative LLMs.
bigfishrunning 12 hours ago|||
Ah right, so you like AI and don't care to understand how it works.

It doesn't "decide" anything or "need" any semantic. It derives the likelihood of the token, and "bearing" is likely to come after "load".

Myrmornis 12 hours ago||
Sure but the question is why "load" after X?
bigfishrunning 12 hours ago|||
Because, for some high number of contexts, its likelihood comes out high in the big tree of multiplies that is claude's model. For some sets of 500 words (or whatever), the next word is "load". The classifier that decides which sets of 500 (or whatever) words is a prefix for "load" is returning "true" too often.
bunderbunder 12 hours ago|||
More-or-less the same principle, but scaled up massively, and with context-dependent probability conditioning maps.
EMM_386 8 hours ago||||
> but you don't see "load bearing" nearly as often in prose written by people

Unfortunately, we're starting to now.

Thanks to Claude.

bunderbunder 13 hours ago||||
And like any good corporate buzzword, it’s merely a simulacrum of precise technical jargon. The way Claude uses it is clearly wildly polysemous if not outright ambiguous.
mattmcknight 10 hours ago|||
What do you replace it with? "necessary dependency"?
bigfishrunning 10 hours ago||
Required, important, irreplaceable, necessary, integral.

There are lots of ways to express an idea besides this one trendy construction metaphor

Terretta 3 hours ago|||
> the concept being referred to is clearly extremely important and valuable to refer to

On the contrary, stock words pop up more easily when it has less confidence.

Stock phrases are a correctness smell.

pjc50 13 hours ago|||
You yourself used "important" in the same paragraph.

"Load bearing" is a metaphor, while the other single words are more direct expressions. Unless the thing that Claude is referring to is a wall or other structure, which may truly bear load.

This is one of those issues which translators are long familiar with. There's no direct translation for "schwerpunkt" that isn't slightly longer.

hresvelgr 13 hours ago|||
In the figurative sense it's highly versatile across contexts, but still replaceable. For example:

"Her optimism was load-bearing,"

versus:

"Her optimism was enduring."

Exactly the same meaning and connotation. It stands to reason that the terms with the most semantic flexibility will have preference across all contexts. So in response to:

> maybe we should be learning from Claude rather than complaining.

I'd say let's not steer ourselves into regular language and keep some vivacity in our expressions.

SideburnsOfDoom 12 hours ago||
> Exactly the same meaning and connotation.

No, it does not have the exact same meaning.

The first means that her optimism kept her in some functional state, without it, she would collapse.

The second means that her optimism continues over time, despite obstacles.

The first doesn't emphasise how longstanding her optimism is, the second does. The second doesn't emphasise how important her optimism is, the first does.

geraneum 10 hours ago|||
> Claude has recognized some important semantics that we ourselves lack a good word for or at least under-appreciate.

Ah, I love when Claude reads our collective minds and fills in the gaps to address the load-bearing seams genuinely with an honest caveat.

SubiculumCode 9 hours ago|||
'Load-bearing' is a physical analogy. Other words like 'pillar' imply the same physical analogy.
alistairSH 13 hours ago|||
You're serious?

Operative, key, and critical are all more correct to me in this context.

Myrmornis 12 hours ago||
For me, "key", and "critical" merely say it's "important", but don't convey the sense that "out of the mess of connected concepts we're discussing, the one that is actually interacting with the thing we care about, or at least dominating the interactions with the thing we care about, is X".

"operative" is a bit better, but I think of it as referring to grammatical interactions, i.e. interactions at the level of language mechanics rather than semantics.

fellowniusmonk 10 hours ago||
I mean we have all kinds of under synonym'ed words. Just look at how few we have for "smell" (as in the act of smelling), and then how overloaded the word smell even is.
mikewarot 6 hours ago||
I strongly suspect it's tokenization that drives this. If we trained with ASCII or even UTF8, I think we'd have much better results.
bellowsgulch 5 hours ago|
Self-attention is an O(n^2) operation. You don't want to train on individual characters, or bytes.
juvvel 7 hours ago|
I've recently noticed an increase in "bite". "This will only bite if..." It also loves "stress-testing", "matrix", "anchor" and "flagging".
dpkirchner 7 hours ago|
It's recently replaced "honest" with "straight". "Belt-and-suspenders" is still common, I don't know when they'll replace it.
juvvel 2 hours ago||
English is not my native language, but I consider myself fairly fluent. I've never heard the expression "belt-and-suspenders" before Claude.
More comments...