Top
Best
New

Posted by swyx 1 day ago

PingCap TiDB Leaks(fulcrumsec.vg)
248 points | 35 comments
llama052 2 hours ago|
https://www.pingcap.com/trust-hub/security/security-update-o...

I find it really baffling how much they are downplaying this incident on their statement.

”An external incident response firm reviewed PingCAP’s production systems and found no evidence that the attacker ran commands or maintained persistent access in the systems reviewed”

That does not appear to be true.

bombcar 2 hours ago||
Certainly there was no evidence; they likely have no logging anyway!
zergrush 2 hours ago||
since they pasted customer creds in jira tickets they most likely are very liable hence the downplaying

im not an expert but if I was an investor I'd try to find a buyer for my shares and run

alright2565 30 minutes ago||
> in the systems reviewed

is load bearing I expect.

aliasxneo 2 hours ago||
> PingCAP's engineers paste customers' production credentials into Jira tickets.

Holy hell, I've heard of this happening, but I've never personally seen it in my 10 years as an SRE. That's absolutely wild.

adamparsons 2 hours ago|
It sounds like their jira instance was truly the keys to the kingdom, given the creds _and_ tickets describing all the flaws needing fixing. A golden README.MD to escalate to their hearts content
xKingfisher 22 hours ago||
Coming this close on the heels of the security audit by NCC [1] is pretty embarassing for all parties.

[1]https://www.pingcap.com/press-release/tidb-ncc-group-securit...

hintymad 10 hours ago||
> TiDB, the open-source distributed SQL database powered by PingCAP, today published the results of a rigorous source-code security assessment by NCC Group, one of the world’s leading cybersecurity consultancies.

It looks like you can assess the hell out of your source code, but your system can still leak if you don't secure your operations.

somat 52 minutes ago||
There was a quote from back in early web days that has stuck with me, Still relevant today.

"good opsec will save you from bad crypto. but the converse is not true, good crypto will not save you from bad opsec"

kobieps 11 hours ago|||
From personal experience having worked with multiple "enterprise-grade" pentest vendors (including NCC), I think the entire pentest industry is overdue for a big shake-up.
jacquesm 3 hours ago||
No particular opinion on NCC but a lot of that stuff is pay-to-play.
dherls 23 hours ago||
If true, this is next level incompetence from PingCap. Apparently the attackers set up a replication pipeline for a month?!

> We even stood up a replication feed of their own control-plane database using credentials committed in their own repositories — GCP service-account keys and an Azure service principal — and let their infrastructure deliver it to us. Every six hours, for the last twenty-two days of the campaign, from 8 September to 30 September, that pipeline faithfully re-exported every table of the operational heart of TiDB Cloud — tenants, users, API keys, cluster credentials, changefeeds, migrations — and pushed it out.

neya 1 hour ago||
Pingcap's statement:

    With support from outside counsel and third-party forensic specialists, there is no evidence that data stored in TiDB was impacted. We keep on investigating and will provide updates on any new findings.

They have the fucking data in a tarball and Pingcap claims no data was impacted. This sounds like the bad blood story part 2 all over again.
arpinum 1 day ago||
AWS private rates gives PingCAP ~47% off list price. Wonder which services got the biggest discounts? Unsurprisingly for a db company the cross-az traffic is 15% of their bill.
driverdan 32 minutes ago||
Sounds about right. The more you use the deeper the discount they'll give you.
perpetualpear 1 hour ago|||
You can get some sweet deals on s3, assuming you store 10-100s of PB
gooseai 1 day ago||
[dead]
nemothekid 23 hours ago||
Man I recently executed a migration from Aurora to Planetscale. I seriously considered PingCap but decided against it because I thought they cloud pricing was too complex. I wonder if my personal information is in the leak.
wannabe44 21 hours ago||
> Summary: "The root password of the cluster can be reset unconditionally"

But what matters is that it was all memory safe and had no data races.

boorbat 14 hours ago|
You realize it's written in Go right?
wannabe44 13 hours ago||
Not even data race safe then. NGMI.
thenthenthen 3 hours ago||
Why is Baidu among their clients
dangoodmanUT 1 day ago|
what is happening today

and how are people not talking about this more

dilyevsky 22 hours ago|
only the beginning. next year or two are going to be wild on this front so buckle up...
More comments...