Top
Best
New

Posted by bearsyankees 9 hours ago

Reverse engineering a $1B Legal AI tool exposed 100k+ confidential files(alexschapiro.com)
504 points | 161 commentspage 3
yieldcrv 6 hours ago|
I've worked in several "agentic" roles this year alone (I'm very poachable lol)

and otherwise well structured engineering orgs have lost their goddamn minds with move fast and break things

because they're worried that OpenAI/Google/Meta/Amazon/Anthropic will release the tool they're working on tomorrow

literally all of them are like this

ethin 3 hours ago||
I'll be honest... I'm not at all surprised that this happened. Purely because it seems like everyone who wants to implement AI just forgot all of the institutional knowledge that cybersecurity has acquired over the last 30-40 years. When you "forget" all of that because you want to rush out something really fast, well, you know what they say: play stupid games, win stupid prizes and all that.
corry 6 hours ago||
"Companies often have a demo environment that is open" - huh?

And... Margolis allowed this open demo environment to connect to their ENTIRE Box drive of millions of super sensitive documents?

HUH???!

Before you get to the terrible security practices of the vendor, you have to place a massive amount of blame on the IT team of Margolis for allowing the above.

No amount of AI hype excuses that kind of professional misjudgement.

me_again 4 hours ago|
I don't think we have enough information to conclude exactly what happened. But my read is the researcher was looking for demo.filevine.com and found margolis.filevine.com instead. The implication is that many other customers may have been vulnerable in the same way.
richwater 7 hours ago||
Of course there will be no accountability or punishment.
fallinditch 6 hours ago||
> ... after looking through minified code, which SUCKS to do ...

AI tends to be good at un-minifying code.

a_victorp 6 hours ago||
Legit question: when working on finding security issues, are there any guidelines on what you can send to LLMs/AI?
fallinditch 4 hours ago|||
I got downvoted, so maybe that means someone thinks un-minifying code is not advised for dealing with security issues? But on reflection surely you can just use the 'format code' command in the ide? I am no expert but surely it's ok to use AI to help track down and identify security issues with the usual caveats of 'don't believe it blindly, do your double checking and risk assessing.'
CER10TY 4 hours ago|||
Personally, I'd just use common sense and good judgment. At the end of the day, would you want someone to hand your address, and other private data to OpenAI just like that? Probably not. So don't paste customer data into it if you can avoid it.

On the other hand, minified code is literally published by the company. Everyone can see it and do with it as they please. So handing that over to an AI to un-minify is not really your problem, since you're not the developer working on the tool internally.

nodesocket 2 hours ago||
Doesn't Chrome Developer tools automatically un-minify?
Invictus0 8 hours ago||
This guy didn't even get paid for this? We need a law that establishes mandatory payments for cybersecurity bounty hunters.
lupire 7 hours ago||
Who is Margolis, and are they happy that OP publicly announced accessing all their confidential files?

Clever work by OP. Surely there is automatic prober tool that already hacked this product?

dghlsakjg 2 hours ago|
> Who is Margolis, and are they happy that OP publicly announced accessing all their confidential files?

Google tells me they are a NY law firm specializing in Real Estate and Immigration law. There are other firms with Margolis in the name too. Kinda doesn't matter; see below.

I doubt that they are thrilled to have their name involved in this, but that is covered by the US constitution's protections on free press.

2ndatblackrock 6 hours ago||
now that's just great hacking
imvetri 8 hours ago||
Legal attacks engineering - font type license fee on japan consumers. Engineering attacks legal - AI info dump in above post.

How does above sound like and what kind of professional write like that?

chunk1000 8 hours ago|
Thank you bearsyankees for keeping us informed.