Top
Best
New

Posted by gumby 5 hours ago

AI coding agents generate more code, but not more software(arstechnica.com)
265 points | 216 commentspage 2
hyperpape 4 hours ago|
I read this paper several days ago, when my director shared it. Several things jumped out at me:

- the data is mostly from 2025 and earlier

- the baseline mean lines of code per month was 5017, the estimated increase was 1494 lines per worker-month

- the baseline is 5.34 PRs per month, and increased by 1.22

- the baseline mean for code review is 7.03 days

The second and third bullets are confirmation that this is old data. In late 2026, people aren't delivering 30% more lines of code. If people were just producing 30% more lines, they'd still be reading every line. My point isn't that "more lines is good". I'm worried about a few too many lines of code that no one reads. My point is that this shows the data is old.

For the latter, I'm a bit annoyed by using mean, median would be more valuable, but I think it's safe to say that the engineering culture was already pretty bad. If your average pull request sits for 7 days, you evidently don't care about shipping anything, and agents aren't going to change that.

uncivilized 4 hours ago||
You read the paper, saw that the stated collection dates ranged from January 2021 to March 2026, and are claiming the authors are lying?
hyperpape 3 hours ago||
If you’d asked reasonably, I might have noted the slight correction (I misremembered that data collection ended January 2026, not March).

But since you’re such a charmer, why did you read the word “mostly” then lie about me lying?

It’s unambiguously true that most of the data (including that on coding agents) is from 2025 and earlier.

uncivilized 2 hours ago||
Mostly 2025 and before means mostly 2025 and before…
hyperpape 2 hours ago||
Mostly, meaning “more than half”, or perhaps “noticeably more than half”, both of which are literally true.

Do we speak different versions of English or something? I’m genuinely past being annoyed, I don’t actually know why you think what I’m saying is false.

radlad 4 hours ago||
I'm noticing AI catching many bugs in code that previously went unnoticed. Some of them are important, and it's great to catch them early.

The other 11 items in the list of 12 would probably never be hit in practice, but now that you know, you have to sort out how to handle each (even if that just means documenting, filing, or ignoring: you have to understand each of the disparate 12 issues first.)

giancarlostoro 4 hours ago||
Before it was all coding on its own, I asked a model for bugs in a new project, saved me the 15 minutes of new web project I waste every time trying to remember obscure first time setup things you dont touch for years in under a minute.

I suspect theres a lot of hours saved that are otherwise wasted by devs when some simple thing throws off their implementation completely. Basically we cant measure the saved developer hours by LLMs because it could be literally anything.

daveguy 2 hours ago|||
This stuff is still 90% garbage hype. See also:

https://www.youtube.com/watch?v=NnV_cWeoo5Q&list=LL&index=3

subtlejellyfish 45 minutes ago||
[dead]
dolebirchwood 1 hour ago||
From the study:

> We study the impacts of AI coding assistants and agents on software engineering work... across 718 firms.

> Our primary source of data is Jellyfish (“JF”), an analytics platform used by firms to understand the activity of their software engineering teams.

What about all the software being built by everyone else not using Jellyfish? What about the small companies that don't have the same operational bottlenecks and truly are building more than their larger competitors? What about the solo founders starting companies and building software which they never would have built without AI?

matsemann 1 hour ago||
I don't think my team has delivered any more usable and needed features than before. If anything, we're running faster in the wrong direction, or things just gets never-ending scope creep or whatever.
timmmmmmay 4 hours ago||
I'm completely uninterested in the opinion of a video game journalist on what does and doesn't work well in writing software. The author knows about as much about writing code as he knows about performing heart surgery
archagon 55 minutes ago||
You are free to not comment in the future!
cavemandaveman 4 hours ago||
Ars Technica in general has also been catering to their knee-jerk anti-AI audience. I used to find their comments section somewhat interesting but now it's the same old tired, outdated dunks on AI.
jack_sunsetless 2 hours ago||
Agree. There's more code, but what's the trade-off? Fewer people on the team understand what's actually in there, so there are more and more bugs. Of course the agent will happily fix each one, and break three other things on the way, because nobody stopped to ask why the code looked the way it did.

Feels like we're building legacy code at a record speed.

krona 1 hour ago||
"There are two ways of constructing a software design: One way is to make it so simple that there are obviously no deficiencies and the other way is to make it so complicated that there are no obvious deficiencies. The first method is far more difficult." - T. Hoare (1981)
joshheitzman 3 hours ago||
Any study that wants to say anything about the impact of coding agents on whether more software is being created or not can't limit itself to what firms are doing that create a footprint of "work events — including GitHub coding activity, Jira issues, and Google Calendar events".

This is software that would not existed without coding agents: https://fluximp.org

Sure its a coding agent itself, but I would never have tried to create it manually as I would have expected it to be too much work to see it through as solo dev. There were no issues created anywhere, no calendar events, and there is very little github activity (I primarily used Mercurial on a private server; git is just for distribution).

I started it with Kilo Code and after a couple of months it was purely self-modified and has been since then. I was a bit worried that it wouldn't work on Linux and I'd either have to use another agent or use it running on my Windows box to modify the code on my Linux box to get it working, but it just worked so the streak of being self-modified has continue.

I want to make an indie game and I'm working towards that with the project I'm using to benchmark FluxImp. My first job was as game dev and I took a shot at indie game dev 20 years ago (failed; not fun). Its something I had long written off as too time consuming to even start, but with coding agents I no longer feel that's true.

All of the stories about non-software engineers making small software that is useful to them also seems unlikely to generate the kind of footprint that lends itself to being easily studied.

forgotaccount3 3 hours ago||
I don't see how AI coding agents are going to create 'more software' until the PO's and PM's of the world step back and let developer's communicate directly with the stakeholders. Or the PO's and PM's could cross-train on AI coding agents.

We are still being stressed to create all stories with such fidelity that 'any' developer can pick it up and implement it in the timeframe allowed for the size the story was given. When the story is written in that detail, we may as well copy it into an AI agent and have it implement it. But we can't do that, so we have people who have SME write up story's that sit in the backlog for 2 weeks until a developer can bring it in, so that they can spend a day implementing it (really 2 hours with 2 hours of meetings and 4 hours of video games) because the smallest pointing size we can give is 1 point and people aren't allowed to take on more than 8 points a sprint.

How can we expect things to get done faster when the team that reports work up to senior management put's such strict limitations on our throughput?

dingaling911 3 hours ago||
Listen man. Let me give you a tip.

Don't take it seriously.

Efficiency is not your job, until you can 1) solve it, 2) present the solved and implemented problem to senior leadership in one fell swoop.

Corporate America is a giant slush fund and this is how it keeps going.

Be grateful!

jimbokun 3 hours ago|||
What kind of professional would spend 4 hours of their time per day playing video games?

The true professionals spend those 4 hours making snarky Hacker News comments.

tene80i 3 hours ago||
I would be more concerned with playing video games half the day than whether the PMs are slowing you down by figuring out the requirements
atleastoptimal 4 hours ago|
Yes, instead of reviewing 1,000 lines a day I now "review" 10,000 lines a day. My brain is not 10x faster, so either I spend 10x more time reviewing code, or I just opt to accept that AI is probably right based on the complexity of the problem. However I realize that if we just let the agents loose on the codebase, everything would speed up like 100x.

Invariably once certain AI models in certain domains reach "full automation" quality this will happen, until now the human eyeball bottleneck is holding a leash on millions of tireless superhuman coders who have just a few narrow but egregious contextual awareness issues.

mohamedkoubaa 2 hours ago|
A rocketship pointed in the wrong direction is not going to get to mars. Steering is probably the next evolution of code review
More comments...