Top
Best
New

Posted by surprisetalk 2 days ago

Maybe there's a pattern here?(dynomight.net)
114 points | 65 comments
abetusk 2 hours ago|
A pattern that keeps repeating:

https://dresdencodak.com/2009/09/22/caveman-science-fiction/

seydor 3 hours ago||
Yeah the pattern is , "with great power comes great irresponsibility" , which is only confained when the power is matched by rivals
redhanuman 3 hours ago||
Gatling died in 1903 and he never saw his gun used in a trench and the engineers at Anthropic, OpenAI, Google they're watching it happen on X in real time..that's the difference nobody's talking about So Does seeing it change anything? I genuinely don't know.
nilirl 3 hours ago||
I see the pattern the author wants to show me, but what about it?

Civilization is a complex, evolving system. How much predictability and control do we really have?

chihuahua 5 hours ago||
The Gatling quote is hilarious. Did the inventor of the machine gun really think that each company of 100 men was going to be reduced to one guy with a Gatling gun, and 99 of them send him to the battlefield by himself, saying "good luck buddy, let us know how it works out?"

The army was going to be reduced by a factor of 100, and two tiny armies were going to face off while the majority of men of fighting age were going to sit at home and paint landscape paintings? Really?

closewith 32 seconds ago||
[delayed]
jdndbdjsj 4 hours ago|||
Yet everyone is saying this about LLMs and coders
zmgsabst 4 hours ago|||
But… it did do that.

> that it would, to a large extent supersede the necessity of large armies, and consequently, exposure to battle and disease [would] be greatly diminished.

Our force structure shifted towards logistics and infrastructure from combatants as we moved up the weapon complexity hierarchy. First automatic guns, then tanks, then airplanes.

To a large extent, a tank or air crew is 50 guys waving off 1-5, while they sit back at base and do hobbies between bouts of mechanic labor. They’re not literally at home, but we do fight with small mechanized armies while most soldiers watch on from the base.

closewith 5 minutes ago|||
[delayed]
AndrewKemendo 3 hours ago|||
Right

It wasn’t over night but it did exactly what it intended and sped up a battle significantly as though you had multiples of troops compared to a musket firing line

Then miniaturized it becomes the SAW

mmcromp 4 hours ago|||
I don't know if this is your point, but we're hearing the same stores with AI. Do these people really mean what they say or are they just lying to paint themselves as honorable
01HNNWZ0MV43FF 3 hours ago||
A little "How many people were soldiers in ancient Rome" type searches gave me these numbers...

16% of adult males in the Roman mid-republic (https://en.wikipedia.org/wiki/Roman_army_of_the_mid-Republic...), call that 8% of adults of all genders.

Wikipedia says that there's about 1.34 million people in active duty in the US military, out of about 342 million people, 21.5% of which are under 18. (https://en.wikipedia.org/wiki/Demographics_of_the_United_Sta..., https://en.wikipedia.org/wiki/United_States_Armed_Forces)

I think that's 0.5%? Down from 8% in ancient Rome?

applfanboysbgon 1 hour ago||
That has little to do with technological advances, just the fact that the US is at an imperial peace; ie. it is under zero threat of invasion and is currently only engaged in small-scale imperial adventurism across the globe which does not require a large standing army. ~16% of adult Americans served in WW2, or ~33% of adult men.
ineedasername 2 hours ago||
“Maybe there’s a pattern here”

Is is that surprisingly few weapons inventors expressed regret and doubt? Or just that very few wrote about it?

Snark aside, we have massively more people alive today than in 1900 and yet the proportion of people that die in armed conflicts is— while horrific- barely noteworthy in most years around the dawn of the 20th century and not infrequently dwarfed by the body counts racked up in those days.

onion2k 1 hour ago||
Snark aside, we have massively more people alive today than in 1900 and yet the proportion of people that die in armed conflicts is— while horrific- barely noteworthy in most years around the dawn of the 20th century and not infrequently dwarfed by the body counts racked up in those days.

That's true if your definition of 'die in armed conflicts' is limited to 'the soldiers on the battlefield.' If you extend that definition a little to 'people who would not have died if there hadn't been an armed conflict' then you need to scale it up to about a million people a year today. That's just from 5 countries where it's been studied. Globally it's likely to be much more. There's some good information about it, from a credible source, here: https://costsofwar.watson.brown.edu/costs/human

bryanrasmussen 1 hour ago||
you also need to compare people injured so badly that they are significantly worse off for life after the war is over, as most of those people would probably have been killed in previous wars but thanks to modern medicine can be kept alive to suffer for years afterwards.

not a knock on modern medicine, and probably the people who survive are happy that they did for the most part, however if you compare the results in the way you did, you should compare those as well.

morninglight 7 hours ago||
We need to break this pattern of kinetic weapons.

How about some modern, safe bio-weapons.

rationalist 6 hours ago||
It has bio in the name - it must be good!

That means they're made from renewable resources, right?

coffeebeqn 4 hours ago||
As long as they’re USDA Organic
jiehong 4 hours ago|||
I just watched an episode of Babylon 5 in which an entire race gets wiped by a virus in that way In a matter of days.
zabzonk 2 hours ago|||
How do you test "safe bio-weapons"?
ares623 4 hours ago||
Clincally proven bio-weapons
InsideOutSanta 1 hour ago||
Side effects may include victory.
hackyhacky 6 hours ago||
tldr: many great scientific advancement were created by well-intentioned researchers who were subsequently shocked to find their work applied to military, often to the great detriment of mankind.

The unwritten implication is that this applies to AI, as well. I find it hard to disagree. I don't know what to do about it.

The HN crowd is elated that we can finally finish our side projects, while the ruling class is already using AI to subvert democracy, spread misinformation, and develop weapons. "If we don't build these weapons, someone else will." If we can learn nothing else from history, we should learn that you can't turn back the clock.

3836293648 4 hours ago||
No, this does not apply to AI because they're not well intentioned and very open about it.
lich_king 5 hours ago|||
I think both things can simultaneously be true. There is a certain inevitability to technological progress. Once you reach a critical mass of collective knowledge, the resulting "thing" will get developed. If not by you, then by someone else.

But also, inevitability is not an argument for complicity. If you personally decide to work on bioweapons, I don't think you can shrug and say "eh, it was going to happen either way". As tech workers, we've really mastered the art of coming up with justifications for what essentially just boils down to "all my friends have gotten rich and now it's my turn".

I've met hundreds of sharp engineers from Facebook, Google, Microsoft, etc. None of them could look me straight in the eye and say "yeah, you know, what we're doing with ad tech is actually good". They just always had an explanation along the lines of "it's not that bad, and besides, if we don't do it, someone else will, and we're the good guys here".

godelski 4 hours ago||

  > besides, if we don't do it, someone else will, and we're the good guys here".
It's funny that people justify themselves that way considering it's the literal phrase is discussed in every ethics 101 course... and not because a bunch of good people were saying it...
bluefirebrand 2 hours ago|||
If the comments on this website are any indication I'd wager a great many people in tech haven't spent even a single minute of their lives seriously thinking about ethics, nevermind studying ethics in a classroom
bdangubic 2 hours ago||
- first 10 years of my career, ethics was last thing on my mind

- second 10 years of my career, started seriously thinking about ethics

- last 10 years of my career (including now) - would not work for Big Tech etc if they gave me 9-digit / year compensation package

9dev 2 hours ago|||
Yep. From Putin to Kim Yong Un, everyone is convinced to be the good guy doing bad things for the right reasons.
vlovich123 4 hours ago|||
That’s a weird tldr and not my takeaway. More like “scientists convinced their new ultra destructive weapon is sure to bring about peace this time around”. Spoiler: it does not. Arguably maybe nuclear weapons but even then I’d say the use of nuclear weapons in armed conflict hasn’t really been tested yet and people are generally hesitant to do so, preferring instead illegal chemical and biological warfare.
6177c40f 6 hours ago|||
Reminds me a quote from Gibson's Spook Country: "That's something that tends to happen with new technologies generally: the most interesting applications turn up on the battlefield, or in a gallery."
godelski 4 hours ago|||

  > The HN crowd is elated that we can finally finish our side projects, while the ruling class is
happy that they can finish their side projects too.
nwhnwh 4 hours ago|||
If you wanted the core of all of this... Check this book "Irrational Man" by William Barrett.
porridgeraisin 1 hour ago||
> were created by well-intentioned researchers who were subsequently shocked to find their work applied to military

oh please.

Most scientific development especially root-node stuff has been funded and kick-started by the military for centuries. You can't take funds from DARPA and then be shocked to see the air force using it. You can't work at ecole polytechnique and be shocked to see your work being used in libya.

Humans would have never gone to space [as quick and as at much scale as they did] if they didn't want spy satellites and ICBMs.

Shannon invented a whole new field while working with money earmarked for cryptography work in WW2.

Machine translation was first posed and funded by anyone for russian-english translation - 1949 Warren Weaver memo at the Rockefeller Foundation.

Do see my other comment for more examples.

https://news.ycombinator.com/item?id=45364917

https://news.ycombinator.com/item?id=45365211 [Context: the creator of waymo was the winner of that challenge]

And need I mention the internet itself...

As the first comment I linked mentions, even many medicines were developed only cos soldiers were dying in theater, not because normal people were dying at home. So it's not just limited to tech.

> the ruling class

No, we don't get to deflect blame like that. If we take money from DARPA/similar to invent something, we are part of the system and are responsible. Everyone involved in the space race in the 50s, Transit (sat nav) in the 60s knew it was to make ICBMs. The creator of waymo surely read that DARPA document I linked in my second comment. And need I mention that oppenheimer knew why nuclear energy was being harnessed :) You can't "oh the evil few tricking the innocent majority, what ever will they do" it away.

A logically defensible position might be that you agree that war is a timeless motivation and that you are fine with stuff being used for military purposes and continue to develop the technology with government money, OR not taking any money from the government. There are not that many others that aren't hypocritical.

MediaSquirrel 4 hours ago||
Nukes gave us peace and freedom.

We've had no WW3 (so far) and no one here needs to worry about being drafted into a war. Gatling might have thought his gun would reduce the number of war fatalities, but but Oppenheimer thought he would end the world. Both were wrong.

Alternative take: Inventors are bad at predicting the downstream societal effects of their inventions.

treebeard901 4 hours ago||
Let's assume a nuclear exchange happens at some point during a war. There is a very high chance that this will cause an escalation leading to a nuclear apocalypse.

Since this result is presumably inevitable at increasing frequency, it's more like nukes prevented another major world war and stole a form of peace from the future, temporarily. That peace debt might be repaid with the end of everything.

KronisLV 3 hours ago|||
https://en.wikipedia.org/wiki/Nuclear_close_calls
nehal3m 1 hour ago||
Funny how the unintentional close calls become more sparse with time. I wonder if that’s because humanity got better at dealing with the responsibility or because the oopsies haven’t been declassified yet.
testaccount28 3 hours ago||||
let's assume the trees rise up and set fire to the ionosphere.
ares623 4 hours ago|||
well whatever society is left will definitely be "peaceful" for at least a couple of decades.
jiehong 4 hours ago|||
It very much depends on where "here" is.

At least, it gives impunity to attack others with less fear of retaliation…

zabzonk 4 hours ago|||
> no one here needs to worry about being drafted into a war

Lots of talk in the UK recently about conscription.

imjonse 1 hour ago|||
Croatia:

https://www.reuters.com/business/aerospace-defense/croatia-r...

awjlogan 2 hours ago|||
I haven’t heard a peep about conscription, can you provide a source? There was some vague national service proposal for school leavers a couple of years ago, but that was it.
zabzonk 2 hours ago||
Among many others: https://www.express.co.uk/news/uk/2178935/uk-issued-conscrip...
imjonse 1 hour ago|||
> no one here needs to worry about being drafted into a war.

here meaning the US or HN?

wat10000 3 hours ago||
Nuclear weapons traded a high probability of a major war for a low probability of an apocalyptic war.

My question is, how low is that probability, exactly? Because the tradeoff looks very different if it’s one in a million per year, versus one in a hundred per year.

My assessment, looking at the history and the close calls, is that it’s more like one in a hundred.

9dev 2 hours ago||
It certainly rises if the USA votes for an irresponsible crook.
More comments...