Top
Best
New

Posted by DeepLogin 17 hours ago

Israel creates fake think tank in likely attempt to dupe AI chatbots(responsiblestatecraft.org)
766 points | 437 commentspage 5
megous 1 hour ago|
BTW, Israel's now pretty obvious genocidal acts against Palestinians are now finally clearly visible on Google maps:

https://earth.google.com/web/search/gaza/@31.28918718,34.255...

This is the city of 300k people that they erased along with the entire countryside (lot of the erasure happened outside of any fighting as reported by Israeli online news websites at the time).

And they did so right after getting order from ICJ to not do so and prevent any genocidal acts. So good luck for them not losing the genocide case. Massacred thousands of people in a week doing similar erasures in the north, where they prevented people from leaving while leveling entire city blocks, sometimes killin few hundred people at once in single attacks.

This is what they're attempting to justify with their propaganda.

Google and western so called civilized satellite imagery companies of course continue censoring/hiding similar behavior in Lebanon and other parts of Gaza for Israel's benefit. They only show it years after giving Israel plenty of time to execute their mass attrocities.

anigbrowl 8 hours ago||
This seems like an especially clumsy attempt at chatbot influencing/search engine optimization, bu tit's symptomatic of a much winder problem. Regardless of the underlying issue, there's a non-profit-industrial complex that has turned think tanks and opinion formation into a science, and a whole PR industry masquerading as news which is worse than the 'yellow journalism' of generations past.

Disinformation and cognitive spam are all forms of information pollution, and our information environment has been massively degraded over the last few of decades - both by greedy and short-sighted opportunists, and and by cynical sociopaths who know exactly what they're doing. I think AI has great potential to be a supplement to media literacy and to effectively categorize and filter news-assertive content based on its timeliness, factual density, and presence of absence of emotive and rhetorical manipulation. But if we're not careful we're going to see the environment being wantonly polluted for the express product of shaping model outputs.

It remains to be seen whether objective measurement techniques from the NLP field combined with pruning and other model refinement techniques can limit or reverse propaganda undertakings like this.

gib444 9 hours ago||
"it's just marketing everyone does it"
jmyeet 11 hours ago||
It's been about 20 years since I read Neal Stephenson's Anathem and (SPOILERS) one thing I think about is the Reticulum, which is the Internet on this world. One aspect is that it's full of what we would now call slop. A lot of it is subtly changed by agents and there are other agents you can use (and, I assume purchase?) that will weed out the fake information. It's basically an arms race of disinformation and slop.

I've thought about this many times over the years. I think we've now reached the point where that's going to happen. And state actors seem like the obvious first offenders.

Google is relatively good at filtering out astroturfed pages from the top of search results but they've also have years when a Turkish government page denying the Armenian genocide was the top result for that event so it's a bit of a mixed bag. Google relies a lot on authority of a domain and that's been relatively effective.

It seems like this authority concept is missing from LLM training and a random comment on Reddit is treated with as much authority as an article by the New York Times. So it's now orders of magnitude easier to poison LLMs with Reddit comments and submissions. And for anyone who doesn't know, brigading Reddit is remarkably easy. It takes as little as a few hundred accounts to get something onto r/all if you're clever. Israeli hasbara operations are absolutely capable of this. And they engage in it.

I'm also reminded in a weird way of pre-atomic steel. For anyone who doesn't know, this is steel made before 1945 that is incredibly low in radiation because we hadn't detonated any nuclear bombs yet. It's valuable for making MRIs and the like that are super sensitive. We actually go and recover WW2 shipwrecks just for the steel. It is a finite resource.

Well, that's what pre-2022 written content is now. It's slop-free content to train AI models on because training them on AI slop is of much more limited value. This goes for everything from books to Youtube videos to Reddit posts. Just like pre-atomic steel, we now have pre-slop human content.

I honestly don't know where we go from here.

mboerwink 10 hours ago||
The comparison to pre-atomic steel is poignant. I have found myself preferring pre-AI sources in some cases even (especially?) for computer related information. It is difficult to view pre-slop info as a limited resource without implying decline until the status quo changes again.
hunterpayne 8 hours ago||
I hate to break it to you. But it took war'ing state-like actors less than a week to start using LLMs for propaganda purposes. There are pictures that most of what some people think/thought were real that never happened. Pictures that form their opinion on political topics. It was literally instantaneous. It was also remarkably predictable in almost all ways...sigh. Even the topics were predictable. And most people predictably fell for it, even the majority of the posters on this very site.
steele 10 hours ago||
State-sponsored propaganda apparatus masquerading as marketing optimization to influence LLMs is the most America-coded clandestine dystopian way of repatriating US taxpayer defense dollars with R&D deductions for the private sector.
firefoxd 11 hours ago||
There's an ongoing sms campaign at the moment, I'll share what I received including phone number so you can verify it:

From: 601-202-1149

> Hey, it's David. Curious what you think about America's relationship with Israel today. Can we chat? Stop2End

It looks to be an LLM response since it includes context from your messages, however it uses the exact same messages at the end of each question:

> One thing that often gets overlooked is how much Israel actually contributes to American security. Their intelligence sharing has helped prevent terrorist attacks on U.S. soil, and their tech innovations end up in American products and defense systems. It's less about charity and more about a two-way partnership that keeps Americans safer.

> Have you ever seen examples of that kind of cooperation?

I ended up just blocking the number.

ChrisArchitect 16 hours ago||
[dupe] https://news.ycombinator.com/item?id=49313477
culi 10 hours ago|
[flagged]
nervai 16 hours ago||
[flagged]
dxsm 16 hours ago||
This article was very relevant to my interests and what I hope to see on this site. I appreciate that you shared it.
arionhardison 16 hours ago||
[flagged]
lukan 11 hours ago|||
Oh, then you surely have a quote?

Because what I think and read is any flamewar topic gets removed - and this surely qualifies.

culi 10 hours ago||||
It's not dang, it's just a bunch of users flagging things. Most of the time, if you email them (no such thing as a ping like @dang), they will actually turn off flagging for a post. Especially if there's a clear technological aspect like this
cadamsdotcom 12 hours ago|||
This doesn't align with my experience - but happy to be proven wrong if evidence can be produced.

Do you have evidence?

zmgsabst 10 hours ago|
[flagged]
verteu 10 hours ago||
> Why is this one in particular different?

The article answers this: For one, the 'papers' are entirely AI-generated.

refulgentis 10 hours ago||
The article talks about how the articles are AI written and written at a super prodigious pace. In an alliterative way, I agree at 50K feet we could say it is the same as putting out opinion pieces. I don’t see any reason it is only noteworthy because presumably some Jewish people are involved.
More comments...