Top
Best
New

Posted by 1vuio0pswjnm7 3 hours ago

Corporate America Is Starting to Ration AI as Cost Skyrockets(www.wsj.com)
81 points | 76 commentspage 2
elevation 2 hours ago|
Another reason to favor using AI to build automation instead of relying on it in prod: the risk of war and global instability.

If LLMs are genuinely helpful or even decisive in a military engagement, you can expect any host country to commandeer whatever data centers they need, leaving commercial entities to bid up the prices on the leftover capacity.

Another risk is that data centers are a great target for cyber warfare.

It’s ideal if your business can leverage LLMs when they’re online but continue to operate profitably when they’re offline.

dangus 1 hour ago||
I’ve seen comments on other threads on this subject the general idea that these article headlines are overstating the pullback from AI.

In other words, the news cycle is looking for an AI story that lands with readers, and that the example of Uber blowing through its AI budget and Microsoft discontinuing use of Claude internally are not good indicators.

I agree that those aren’t good indicators.

However, at some point we have to remember that CEOs and boards of directors are just regular morons who read the news the same way everyone else does.

At some point, if a lot of corporate leaders associate AI with mediocre results, high costs, and public backlash, they might just start saying “this juice isn’t worth the squeeze.”

marcosdumay 2 hours ago||
There's a paywall, but it's an interesting question how much of the recent explosion of the AI companies revenues is because of the explosion in prices, and how much their customers will accept the increased prices.
throwatdem12311 2 hours ago||
It will be interesting to see to see Anthropic’s “revenue bubble” pop as this happens. At least it should hopefully free up some capacity.
ChrisArchitect 2 hours ago||
Some related discussions:

https://news.ycombinator.com/item?id=48268871

https://news.ycombinator.com/item?id=48238896

https://news.ycombinator.com/item?id=48307098

checkaiclaims 3 hours ago||
As a developer, I don’t think it’s just that costs are going up. I’m also seeing more people lately talk about “vibe slop”.
BearOso 1 hour ago|
I've noticed as well. A lot of pull requests are just agents running constantly, hoping to have produced something of value. Entropy is at an all-time high, though.
glass1122 1 hour ago||
[dead]
ath3nd 1 hour ago||
[dead]
feverzsj 2 hours ago|
LLM doesn't work, let alone profit.
ninkendo 1 hour ago||
Yesterday I updated our dependency on the sqlx crate and put up a PR, and it failed in the CI build in a way I couldn’t reproduce locally.

I asked codex to take a look, and it:

- Grabbed the CI logs on its own to figure out what the CI error was

- Looked at my local setup

- Looked at the changes in sqlx from 0.8 to 0.9

And figured out that sqlx depends on an updated version of the “whoami” crate but doesn’t specify default features, which causes it to fall back on a stub implementation that makes the default user “anonymous”, which was failing to authenticate to the UNIX socket we use in our CI Postgres server. It patched the environment variable for our docker container to explicitly specify a username and the issue was fixed.

It would’ve taken me probably several hours to figure this out on my own. It took codex maybe 5 minutes.

Tell me again how LLM’s “don’t work”?

orwin 21 minutes ago|||
I agree with your point in the broad sense, but the example might be bad. If sqlx is an important crate, and not stable yet, upgrading it without reading the changelog is honestly a flaw in your team process. Using the AI to fix organisational issues is typically one of the reasons I'm very skeptical of AI improving productivity in the long run.

I'm not taking a shot, to be clear, we had a similar issue a few years ago and we made sure this wouldn't happen again, that's absolutely not a shot, nor do I think it's a character flaw to use AI, au contraire, this is a very good use. I'm just worried that because AI is so good at fixing minor issues caused by governance/organisation flaws, we will be stuck using it to fix those and be trapped in mediocrity (that's not an issue for me, mediocrity is where I work best, but I'm a bit sad for the great Devs I've worked with.)

ninkendo 7 minutes ago||
> If sqlx is an important crate, and not stable yet, upgrading it without reading the changelog is honestly a flaw in your team process

It’s not in the changelog though, this is an update of a transitive dependency that inadvertently changed the default behavior. sqlx didn’t document this because they didn’t even know it changed.

Even if it was a documented change, our process caught it because it was caught by CI. The issue itself was only a result of how our CI was configured (we had a database url with a domain socket path that didn’t explicitly specify a username, and we inadvertently relied on the default of “the current user”, which the whoami crate now defaults to “anonymous”.) I don’t see an issue in our “team process” (whatever that means) at all.

pocksuppet 36 minutes ago|||
You used it in a way where the result was simple and you could verify its correctness. You used it as a super-search tool, it's good at that. It's a different use case than having it generate a lot of code from scratch.
janussunaj 16 minutes ago||
Exactly. If people understood that this is super-search and super-autocomplete, we'd maybe find a real net-positive use for the tech. But I think the conversational tone will keep fooling us, especially since the LLM providers have heavily invested in that direction.
r_lee 2 hours ago||
elaborate please, how does it not work?