Posted by jatins 12 hours ago
https://www.baldurbjarnason.com/2023/ai-position/ https://illusion.baldurbjarnason.com/
As with most things, most people are somewhere in the middle, as the silent majority. You only see the comments of the strongly aligned, which are also the most emotionally motivated to comment.
The internet is not real life.
I didn't know he'd had a long history of mispredicting AI quality and growth of companies like Microsoft and Google.
There are a myriad of people out there who have brought up genuine issues that AI presents, or preexisting issues that AI is exacerbating.
This series of articles is perhaps the best long form critique of AI as both a technology and an industry I've encountered [1].
[1] https://aphyr.com/posts/420-the-future-of-everything-is-lies...
- safety critics who think AI can take over the world like Yud (I find this the least credible but still valid)
- Bernie type of critics who think AI can cause widespread job losses
- Ruxandra Teslo who thinks AI can remove meaning which I feel is the most serious one [1]
What are not valid
- environmental like emissions and water usage
- AI is useless and it will take the economy with it because it is a bubble
- AI spreads misinformation and causes societal damage
- AI is trained on copyright (are we really on this side of the debate ?!)
Water usage, sure. But emissions has plenty of reasonable concern.
There are the various xAI data centers have/are running using mobile gas turbines.
In general, the extreme amount of power is going to put pressure on the grids. I hope this leads to the world doubling down on renewables to offset it all, but is that going to happen? Hell, the US actively paid [0] to stop a turbine project.
These companies subsidizing green energy expansion, because it's now the cheapest power to expand.
These companies are going to help "correct" the widespread problem with utility monopolies, in the US. Datacenters are deploying their own power generation, partly because power cost no longer aligns with power generation costs. This mismatch is motivating research into local nuclear power generation [1] (which is almost certainly an effort to force the monopolies, rather than actually deploy).
[1] https://www.reuters.com/legal/litigation/big-tech-puts-finan...
Unless you consider natural gass green energy, it's quite the opposite for the moment. This is because the AI build-out is about speed, not cost-effectiveness. That is why xai's Colossus I & II were illegally running gas turbines, and Google recanted its pledge for data center renewables targets.
This point is about power generation companies accommodating the new power demand. It's true that the power companies are keeping coal and gas peaker plants running, that they planned to retire. But, actual additions are all green [1].
And, step functions are inefficient, always, so "for the moment" isn't so unreasonable. Dataceners are something like 100 million tonnes of CO2 per year, where cars are 1,800! So, this isn't some world ending emissions, within this moment. Everything is trending green. Why? Because it's cheaper (thank you China).
Xai using gas turbines is closer to my second point of side-stepping monopolies (improperly in that case), but is also just one example. See previous link for very long term, and all the datacenters using green energy, mid term.
Everyone will do what's cheapest. Luckily, China has made that solar power. We just need to get the monopolies off their asses, and put some of their record profits into actual power expansion. Lucky for them, everyone blames the data centers for all of this. Where I am, the single power company has already raised rates so much, in preparation for electric, that it's more expensive to fast charge an electric car at noon than to buy gas, with a planned 10% increase over the next few years. So, they're dodging criticism too!
https://www.siliconvalley.com/2026/09/01/us-battery-installs...
I fundamentally don't think it is wrong to increase emissions as long as you consider the tradeoffs and externalities. Every single action you do in life has externalities - if you start opposing all of them then what really is your point? You just hate people doing stuff.
If you think emissions are so harmful, try putting a number to it. I implore you to do the exercise and convince yourself or me or others and suggest that the pros don't outweigh the cons. I'm half predicting that the conversation will end in dubious claims about tail risks and world itself collapsing (I hope you don't do that).
I don't think AI is uniquely harmful for the environment given the value it provides. Hell, it can even contribute to accelerating renewable resources and increasing efficiencies overall. There's way more to lose by slowing down AI because of emission control than to gain by reducing emissions.
You can just flip this around and ask why is slowing down AI to control emissions harmful? What numbers that don't make tail risk claims are you providing for this?
>You can just flip this around and ask why is slowing down AI to control emissions harmful? What numbers that don't make tail risk claims are you providing for this?
Slowing down reduces the value it provides to humans, that's clear to me and you I hope.
Because climate change stands to be the biggest market failure in history. You need to show that the rapid scale out of data centers is going to reasonably offset the current trajectory we're on.
Proof?
If AI works out as proponents would make you believe, then either you'll see masses of people out of a job - for which society is unprepared. Or you'll see a big, society-wide productivity boost. Read: consuming non-renewable resources on this planet even faster (not just energy).
Society as a whole would benefit if rollout would slow down. Give us time to reflect on those 2nd-order effects & how to address them. But instead we have the opposite: a crazy race with big AI labs trying to out-spend & out-do the other guy, ignoring externalities everywhere.
- AI centralizes power in the hands of capital, rendering those who can afford compute hardware vastly more capable than those who cannot and thus increasing social stratification
- AI is generally trained on the creative output of humanity without those who train it giving back proportionally (copyright "rules for thee, not for me")
- AI breaks social processes built around the idea that TRYING something is inherently a cost in time or effort, such as filing a legal claim or sending someone a threatening letter. We haven't made the social changes to punish or charge people for using every appeal/option/application, so this makes asymmetric-effort tasks like applying for a job really bad in the interim
- AI use makes it harder to develop the ability to critically think for yourself, especially among those who most need to develop that ability
- AI produces large amounts of mid-tier content, making it harder to discover exceptional human-created creative content produced after AI started to exist
- AI leads to distrust in remote communication, increasing cynicism and breaking social bonds generally. This is NOT your point about "AI spreads misinformation" - no matter whether it's true or not that AI can be used to produce misinformation, having people doubt each other is a harm
- AI demand crunches hardware and time availability for other adjacent markets, such as computer gaming, construction, 3D graphics production, etc. This harms both hobbies and professions in those fields having to cope with rising prices and lower availability of materials
- Everyone is using the same or similar AI, leading to a homogenization of culture and process across humanity. This is perhaps a mixed blessing, because humans are capricious, but less variety can be viewed as a harm
I will also say I personally hate seeing "job loss" said to mean "wealth loss" or "people starving". The goal of life isn't to have a job, it's to be well and happy. If you can be well and happy without a job, great, so it's really painful to me how people don't even see those things are not the same.
Looks to me like I can run Claude Code without being able to afford my own datacenter.
> - AI produces large amounts of mid-tier content, making it harder to discover exceptional human-created creative content produced after AI started to exist
That it does, but I think the real social evil is bad recommender systems. eg YouTube is basically on a mission to drive me insane because it literally only recommends me a) reviews of espresso machines b) video essays by autistic people about Mario 64 c) PBS scienceslop about how quantum physics is super mysterious. None of these are even what I watch, but they're also not what I want to watch.
Until Anthropic bans you from using their data centers, at which point you cannot run Claude Code at all. Welcome to being a have-not (at least in a world where only genAI-assisted coding is acceptable).
He who controls the GPUs controls the world.
Those are two very different things, and the former should be a serious concern. If AI does indeed become a double-digit percentage of electricity usage as the AI labs themselves predict, then it becomes a significant contributor to emissions, full stop.
> - AI spreads misinformation and causes societal damage
> environmental like emissions and water usage
There is real crisis with warming this year, yes the plan to consume staggering anounts of energy and make environment worst in the process is valid criticism.
> AI is useless and it will take the economy with it because it is a bubble
If it turns out to be true, a lot of innocent people get hurt. Valid.
> AI spreads misinformation and causes societal damage
As valid as criticism of facebook was valid the whole time. And yes, facebook made world into worst place.
> AI is trained on copyright (are we really on this side of the debate ?!)
100% valid.
> safety critics who think AI can take over the world
Not valid, that is bullshit. If you think the word is wrong suggest polite word that says the same.
I'm sure I can make a lot of accurate predictions. It doesn't mean I'm worth listening to, if people can't distinguish the accurate from the inaccurate in the moment.
Reminds me of a tactic I've seen often amongst both critics and shills on fads. An OpenClaw fanatic on Youtube comes to mind. He makes opposing claims in different videos. One of them has to turn out to be true, and he trumpets his successes ("Look, I predicted this!"). Only a few notice he also predicted the opposite.
Just look at the other thread about Zitron and his Enron comparisons.
That's relevant because if you make a thousand predictions, a few of them might turn out to be true. That doesn't mean you're good at making accurate predictions.
1. Zitron claims model capability has peaked 2. Zitron claims AI lab growth (user and revenue) has stalled.
In the first case, TFA refutes by claiming 'wrong' repeatedly, which does not convince me of anything. If anything, Zitron is probably right in this regard, since the majority of progress in recent LLM tech has been setting up of guardrails to cajole the models using 'agents'.
In the second case, numbers are given showing growth, directly refuting Zitron. However, I'm giving Zitron the benefit of the doubt, given the old saying - market can remain irrational far longer than you can remain solvent. As long as people can be convinced that the sky is falling, rational predictions rarely pan out.
You don't have to like them, use them, or consider them "good enough", but the idea that models haven't gotten better in the last two years is ridiculous.
Is there any objective measure that shows this?
Would we use examples such as his Feb 2024 claim "I believe we're reaching the upper limits about what generative AI can do"?
> 2. Zitron claims AI lab growth (user and revenue) has stalled.… I'm giving Zitron the benefit of the doubt …
Is there some date by which you'd say it'd be fair to evaluate whether Z’s claims are true (without the benefit of the doubt)?
You mentioned revenue - would we use claims such as his 2024 claim that the companies no longer knew how to grow? But that in 2024, 2025, and 2026 both the companies revenues and profits have grown at double-digit rates each period?
You also mentioned users - would we use claims that "Sundar Pichai wants Gemini to be 'used by 500 million people before the end of 2025, 'a number so unrealistic that someone at Google should have been fired, and that someone is Sundar Pichai", where Gemini then hit 750 M users?
Or by what measures should we evaluate whether Z's claims are true?
I am certain that plugging a circa 2023 model into a 2026 harness would be a pretty frustrating experience. Yes, you could code a bit with AI in 2023, but models are just much better at it than they used to be. And smaller open models are leaps and bounds better at it than they were three years ago.
I use AI every day as I assume everyone else on Hacker News does. Will the S&P 500 drop 20%? I have no idea. If you know, please let me know so I can adjust by 401K.
I share this less to take a shot at Ed but more so that you all know to ask this if you ever hire a PR person.
> list 50 predictions by Ray Kurzweil that he made before 2005, the date he made the prediction, and whether to not his prediction was correct. If it was correct, give some proof.
Of the 50 that were listed, 43 were correct, 7 incorrect.
Dan Luu's analysis of Kurzweil is in this article: https://danluu.com/futurist-predictions/
In the "Appendix: detailed information on predictions" he lists the predictions, and their truth or lack thereof. He was using a list on Wikipedia: https://web.archive.org/web/20170225013846/https://en.wikipe...
For example Kurzweil apparently predicted in 2019 that:
> Blind people wear special glasses that interpret the real world for them through speech. Sighted people also use these glasses to amplify their own abilities. Retinal and neural implants also exist, but are in limited use because they are less useful.
> No
Note that if Kurzweil makes a prediction that an event will occur before year X, and it happens in year X + 1, that still counts as a wrong prediction.
Can you get your un-named source to provide a detailed list of these predictions as Dan Luu did?
> Wrong (Zitron continues to write despite repeatedly being proven wrong)
Technically he didn't say he would stop if he was proven wrong.
Sorry which test results? The gamed benchmarks?