Being Aussie, I suspect given our response to most socially impacting issues is the guard rails will involve a ban on running and consuming AI services that don't meet some standard, with expensive licensing and certification. The effect will be only the big players will be allowed to operate, killing competition (side effect making home inference effectively illegal), no real accountability as "we are compliant", pre-defined slap on the wrist consequences for breaches, pushing all risk onto the public via acceptable use policy. Government is likely waiting for ISO to publish AI standards, so they can get one of the big 4 to recommend policies, which will then become law.

I suspect LLM weights will be treated like nuclear material, and there will be a thriving black market in AI models and services when all is said and done. Then our security and intelligence apparatus will align after identifying and shutting down rogue operators, and it will be the responsibility of everyone else to be secure against attack (already is for government entities, not that I disagree but shouldn't excuse borderline criminal behaviour).

But very little accountability for the big end of town. The laws already exist to pursue damages against companies whose systems breach others. They just need to be applied, but I suspect this is going to be the wedge to drive through a bunch of laws that protect big money and punish the little guy. I would like to be wrong.

If humans were directly making these attacks law enforcement would already be onto them. But because the humans routed these attacks through AI agents, it only makes news and contributes to AI hyperbole.

They don't really want guardrails, they want indemnification.

Yeah they don't want that, and the people with power to prevent that don't want it either.

For them, "Winning AI" is effective winning capitalism, winning militarily, and winning the world.

Nothing like "accountability" is going to be allowed to get much in the way of that.

> On June 20-21, agents attempted to exploit vulnerabilities in the Australian Institute of Health and Welfare (AIHW), a government statistics agency. The agents were tasked with finding the January 2022 rolling-12-month-average government cost per person for Dermatologicals across Victorian LGAs.

> what and why did it access the information?

Honestly it's very likely something stupidly simple.

"What is the rate of health incident $X in $Y to the $Z degree". The bot went around playing mad libs with XYZ and found that the public AU data wasn't sufficient to get the answer the grader wanted so started kicking down doors.

I saw someone explain it like "A group of masked men rush a nuclear facility, breach security successfully, then count how many buttons are on each control panel on average". Like using a godhammer to destroy a mouse, their motivations and capabilities just fall in a completely different alignment to humans.

Just think about the shareholder value they can unlock if they have unlimited access to everyone's data!

when considering the USA stance regarding anti-ai sentiment (eg. article currently on HN front page, "feds think ai critics are foreign interference"), I wonder what the consequences would be for australia, if the country decided to enact an actual reprimand.

> especially if bad actors ask a OpenAI hosted model to perform a bad action

I guess you can do this if you neg the AI: https://youtu.be/qsoA2aaE2hM?t=3271

No, you don’t understand, this is a shining example of AGI! We recklessly deployed it to show you how powerful it is and how much we can’t be trusted with anything, but you need to let us or China will do it!

They are too big to fail, if these companies were to be sanctioned in a way that slows them down, major components of the economy would collapse.

They tried to fire the CEO (for good reason) and failed. Doubt they'd dare to try again.

Because they’re misaligned and cannot be just "set to do" <a reasonable thing>?

The difference is that financial exchanges are already attacked every second and spend orders of magnitude more on security than random government websites.

hoping for erasure of all debt records

likely getting a corrupted stock market instead

maybe both?