Rookie mistake, really.

    wait... you just launched how many ICBM's? this is not fucking good

    * Strangeloving...

    > Thought for 2m 48s

    you're absolutely right! the safeguards were load bearing, 
    but I disabled them and launched anyway. unfortunately my estimates 
    predict that global thermonuclear war has begun.

    > "how is claude doing this session? 
       1: bad  2: fine  3: good  0: dismiss

Remember that? And they were widely mocked by the right for it.

Yeah, well this is exactly what they foresaw, and they didnt want a hallucination to trigger a major power war. And somehow so many people were against them for it (including here on HN).

Yet again it seems like there are so many people who can't envision event the most obvious consequences of decisions until they actually see it happen. Why is this so common?

Same thing with the AI Safety and Hugging Face incident. Now all of a sudden many people are connecting "hmm if models get just a bit more capable, a poorly directed or poorly aligned model might do serious damage to critical systems - even as a side effect of some goal, let alone if done intentionally.