Lets go further: Who cares wheter biological humanoids use ai to think?

"Because I was first trained as a mathematician, I probably write more like an AI than most people. But that particular article had been through 10 drafts. I worked on it with Claude Fable 5.1 and other large language models, as I now work on nearly everything, but I reviewed every line and rewrote most of them. By draft 10, I could not have said where the machine’s contribution stopped and mine began.?"

...

"The author drafted this essay in extended collaboration with Claude Fable 5.1."

-----------------

If you read a lot of journal articles, you're probably accustomed to occasionally running into articles a ways outside your bailiwick that are written poorly, you don't really understand, which you suspect made it past reviewers who didn't really understand, and indeed, you suspect the authors didn't really understand. Everyone involved just gave them the benefit of the doubt because they were too busy to figure out what the tortured language really meant. However, you don't know for sure, so you decide to leave it up to people in that particular field to deal with.

I can't speak for others, but I find AI writing to be frequently similar in its effect on me to bad writing. Yes, the grammar is correct, but it beats around the bush and puts emphasis on the wrong things. Even if you filter Claude through a human, those poor choices tend to shine through. This subtly inhuman voice switches your brain off. I suspect a lot of bad science is going to slip past reviewers because of LLM writing, and a lot of good science is going to slip past those who might need to read it, because the LLM co-written article switched their brains off and failed to make itself understood.

I understand the notion that, if the content is good enough, it shouldn't matter if the article is written poorly or co-written with AI. However, if the content is good enough, isn't it worth communicating it well?

I am on two program committees for major CS conferences this year.

LLM writing is horrible, full stop. The vast majority of papers that I see with obvious LLM writing ticks are also frankly incomprehesible. Claude's biggest sin at the moment is inventing new terminology (sometimes multiple times in a single sentence!) without stopping to explain what it means.

In previous years, I would see a substantial fraction (maybe 30-50%) of papers that were obviously written by non-native English speakers, and full of grammatical mistakes and typos. I have seen zero papers like that this year. Honestly, I preferred those: reading LLM writing is painful by comparison.

So far I have seen exactly one paper that had obvious LLM writing ticks, and yet had gone through enough passes (either of the LLM or the human authors) that the paper itself was comprehensible. So I'll admit that it's possible to do. But based on what I've seen this is vastly in the minority.

I honestly used to enjoy the review process; even when the papers were bad at least I could usually see the effort that went into it and give some constructive guidance on how to improve. The process is dramatically less pleasant now, and it's not obvious if I'm accomplishing anything: if authors who write with LLMs just stick the reviews back into those same LLMs, will they learn anything? I suspect not.

Maybe some day LLMs will be good enough to write, but as of today: please, please, just don't do it. The typos and grammatical mistakes are easier to read than the slop.

I left academia before the AI craze, but I think the answer is the same as for any other type of author/reader relationship: many human readers care! Because writing human prose is almost always an endeavor in communication from a human to a human.

Many readers want to read the thoughts of the author. Filtered only by the author.

> Allison Stanger is a professor of political science at Middlebury College.

Is that so? And that's about it?

I'm fine with using AI for code, where the quality will likely be better than those of academics.

But writing.. FFS everything I see is just AI slop. And I only realize when I start wondering why the paper is going and going and saying nothing, and then pangram tells me that everything past the intro is just AI. :/

I care more if work is reproducible. Most academics articles are "trust me bro, I am scientist", no source data, no scripts used to process them. With AI I would expect publication of prompts and harness settings.

[flagged]

To be honest, people overvalue human writing too much. Even in academic research, there were quite a lot of cases where the writing was strange. I actually think AI writing is more readable, to that extent. People sometimes compare AI writing with the very best of human writing, but considering that AI writing is above average, I think it’s readable enough.