Top
Best
New

Posted by samk3nny 6 hours ago

Technical issue at JPMorgan Chase triggers online banking delays for US banks(apnews.com)
694 points | 569 commentspage 6
50208 4 hours ago|
Queue the "It's Biden's fault" excuse in 3,2,1 ...
ceejayoz 5 hours ago||
"according to the website downdetector.com"

Ugh. DownDetector's methodology is… not great.

Steam isn't down: https://downdetector.com/status/steam/

Amex isn't down: https://downdetector.com/status/americanexpress/

Visa isn't down: https://downdetector.com/status/visa/

AWS isn't down: https://downdetector.com/status/aws-amazon-web-services/

But each has a huge corresponding spike there.

Miraste 5 hours ago||
DownDetector's methodology is fine, it's just noisy. The way to use it is to look at the top-reported failing sites in the ranked list on their homepage, which has been the correct root cause for every major outage I've seen. Ignore the lower ranked ones.
ceejayoz 4 hours ago|||
Google's in the top 20 (#11) right now. Down?

"User reports show problems with Google"

https://downdetector.com/status/google/

Miraste 4 hours ago||
By top-reported I mean the top two, maybe up to four. It's not high-fidelity. I still think it's useful, especially since in 2026 the art of building a status page not dependent on the infrastructure it monitors has been lost.
hinkley 2 hours ago|||
So if there ever is a widespread outage, how will you know? I mean besides "AWS us-east-1 is down" -> "everybody is down".
alala-lala-lon 4 hours ago||||
[dead]
ceejayoz 4 hours ago|||
> By top-reported I mean the top two, maybe up to four.

As the Rick & Morty quote goes, "that just sounds like horrible methodology with extra steps".

Miraste 4 hours ago|||
There's an outage > you go to downdetector > you see the cause of the outage.

Seems straightforward. They could add some qualifiers about the lower ranks somewhere, but that's the base value proposition and it works fine.

ceejayoz 3 hours ago||
There's not an outage > you go to downdetector > it shows an outage > you write a news article, apparently.

> you see the cause of the outage

What does DownDetector say the cause of today's apparent Amazon and Google outages are?

Miraste 3 hours ago||
This kind of rigid thinking is such an HN thing. The "cause" is obviously problems with payments from the bank outages, which, again, is clear from looking at the ranked list.

You can't source details that depend on technical knowledge from a non-technical audience, regardless of methodology. Downdetector is useful nonetheless.

ceejayoz 3 hours ago|||
> The "cause" is obviously problems with payments from the bank outages, which, again, is clear from looking at the ranked list.

You told me only "the top two, maybe up to four" slots count. Five are named in the headline. Only Chase has confirmed any kind of issue, hours later.

(In fact, the article has now been updated to say that Bank of America doesn't have an issue, and suggests it's a Chase-specific outage.)

flkiwi 3 hours ago||||
But downdetector doesn’t track that financial transactions are failing. It tracks whether people are checking to see if a service is failing. It is only a charitable reading that people are only checking if they are experiencing a failure. A signal, user queries, is presented as another signal, service status, even though there is no correlation.
transcriptase 3 hours ago||
In much the same way, every time there’s a large conservative or republican gathering like a national convention in the USA, someone starts spreading fake headlines that “grindr” is down for that specific city. People go to down detector en masse which makes it display that grindr is down (it must be since so many people are checking), lending credit to the hoax. It was never down, and no app has city specific infra that would go down with a spike of a few hundred or even thousand people assuming the premise of the hoax was true.
jacobolus 2 hours ago||
From what I can gather from a quick search, Grindr hasn't gone down in response to GOP conventions, but there is commonly lots of traffic during places/times where GOP conventions happen, and it's plausible that if many people are trying to access a service from the same public wifi they could experience connectivity issues without anything being wrong on the service end.

Grindr CEO: “Yes, it was actually true that there was a significant spike in usage in Milwaukee during the [2024 GOP] convention.”

coldtea 2 hours ago|||
>This kind of rigid thinking is such an HN thing. The "cause" is obviously problems with payments from the bank outages, which, again, is clear from looking at the ranked list.

Not to offend you with all this rigid accuracy, but what you describe is not a cause but an effect.

Miraste 1 hour ago||
Right, which is the reason I put "cause" in scare quotes...
monkpit 3 hours ago|||
Make a better one and we can use it instead!
coldtea 2 hours ago||
We can start by not using a bad one.

False positives and false negatives can be worse than no reporting at all.

monkpit 43 minutes ago||
Sure, while we are at it I’ll stop using my insurance because I’d prefer single payer, and stop using my car because I’d prefer a functional public transit system.

I’ll also stop eating meals cooked for me if I’d rather have something else.

KennyBlanken 3 hours ago|||
[flagged]
creatonez 4 hours ago|||
How do you know some of these aren't experiencing a partial outage? Responding instantly to partial outages that never get reported on status pages seems to be one of DownDetector's biggest strength.
ceejayoz 4 hours ago||
> How do you know some of these aren't experiencing a partial outage?

Is there any other sign they are? That Google, AWS, Steam, Amex, Visa, etc. are all simultaneously having significant outages right now?

> Responding instantly to partial outages that never get reported on status pages seems to be one of DownDetector's biggest strength.

I've predicted all fifty of the last one recessions.

hinkley 2 hours ago|||
I live close (as the fiber flies) to one of the more popular AWS datacenters so I have no doubt that there could be situations where I can access sites that others can't, or in the case of a proper AWS cockup, where I can't but many of you can.

And when it's not DNS (it's always DNS), it kind of depends on how load redistribution works. At some point I have to switch to load shedding, and so Idaho and Montana might just be shit out of luck.

If the NYC office is still able to do work, I don't want the Denver and Chicago office to overload their servers and now nobody can get any work done.

shiandow 2 hours ago||||
Payment not working could be considered a partial outage.
creatonez 33 minutes ago|||
> I've predicted all fifty of the last one recessions.

Meh. I've come to the realization that the answer to the question "is X service up or down right now" is as fuzzy as forecasting the weather or predicting recessions. With giant distributed systems it's always half-down in some unique way. Especially so for anything with a dependency on Microsoft services.

paxy 4 hours ago|||
Also happened last week during the Outlook outage. It showed the entire internet down for some reason.
hinkley 2 hours ago||
I always think of the time the company that acquired us put our Wiki and (some of) production storage on the same drive array and when it failed we couldn't access our runbooks. Lots of anger lines coming off of people who are permanently grumpy the rest of the time. Like people too angry to trust themselves to talk, so one word answers.

After that our operations team got most of its autonomy back.

How do you make an app that watches everyone else's infrastructure but can't be taken out by a common cause?

doawoo 3 hours ago|||
i see this comment on every single "its down" post, it's not a useful comment- it is down, Chase is partially working.
ceejayoz 3 hours ago|||
The article cites a Chase rep saying they are impacted by a bug of some kind.

The article writer then went to DownDetector and wrote a headline "Outages reported at Bank of America, Chase, U.S. Bank, Wells Fargo and Zelle" based on just that. As far as I can tell, there's zero genuine evidence for that.

mylesp 3 hours ago||
Is it not true that Outages have been reported - via DownDetector?

DownDetector is a way for customers to report outages so the headline is not lying at all. It is not claiming that the root cause of these outages are these banks, or that the banks themselves have reported the outages.

ceejayoz 2 hours ago||
> Is it not true that Outages have been reported - via DownDetector?

Yes. That is basically always the case. Bring it up any day, at any time; DownDetector is always reporting spurious outages.

This story morphed into "AI took down a bunch of banks" already because of an irresponsible headline. "Bank outages" is the #5 trending on my Bluesky (https://bsky.app/profile/did:plc:qrz3lhbyuxbeilrc6nekdqme/fe...) right now, still.

ianm218 3 hours ago|||
I’m experiencing degraded AWS ECS service today so it’s atleast a bit helpful. AWS is probably never going to be down accross all regions and all services 100%.
Mogzol 5 hours ago|||
Isn't it just based on user reports? What explains the spike in user reported issues in those services recently?
ceejayoz 5 hours ago||
> Isn't it just based on user reports?

DownDetector considers someone looking up "is Visa down?" a report, even if it isn't.

Click my links and it contributes to those "reports".

One provider has a major issue, and people go there and click into non-down companies, which is seen as a spike.

dubcanada 4 hours ago|||
Is there a problem with that? Do normal people google "is Visa down?" if they don't think Visa is down?

On the other side, does a user google "is Visa down?" going to a website and clicking "yes I think visa is down" any better?

ceejayoz 4 hours ago||
> Do normal people google "is Visa down?"

Normal people Google "is Chase down?", find DownDetector, and click it. (Note that the article has a Chase rep quoted saying they do indeed have an outage, and none from other companies.)

Some of them then click into the DownDetector home page and browse around. Suddenly everything is spiking.

Every time I've seen any one major company with issues, DownDetector has spiked across the board. As it is now. Google and Amazon are apparently down.

akersten 4 hours ago|||
> DownDetector considers someone looking up "is Visa down?" a report, even if it isn't. Click my links and it contributes to those "reports".

Really? It seems to me you have to click a specific aspect of the service to report as down once you land on that page to report an outage.

danso 4 hours ago|||
I assume their methodology weights active reports higher than the implicit ones.
ceejayoz 4 hours ago|||
https://downdetector.com/methodology/

> We process tens of millions of problem reports each month and cover over 36,000 services in 72 countries.

Ask a few normies if they know what it is, let alone have filed a report.

https://downdetector.com/about-us/

> Downdetector collects reports from users and monitors other online sources for service issues.

Or look at the comments on any of the pages. "My card declined"; "18yr femboy down for DM".

nimrodyunana562 4 hours ago|||
https://news.ycombinator.com/item?id=50521819
baxtr 3 hours ago|||
Has downdetector ever been down?!
cardboard9926 3 hours ago||
Don't worry, check here: https://downdetectorsdowndetector.com/
abustamam 2 hours ago||
Has this site ever been down? /s
dmkolobov 2 hours ago||
https://downdetectorsdowndetectorsdowndetector.com/

It's down detectors all the way down.

gamblor956 2 hours ago|||
I can't comment on the others, but Steam and Amex were both partially down earlier this morning.
stackskipton 4 hours ago||
I mean, if Visa/Amex transactions are not working because their bank is down, end users don't know the difference. Card says "Visa" on it, card is not working, end user blames Visa.

Steam/AWS, I got nothing.

anigbrowl 5 hours ago||
[dead]
ahmedketata 5 hours ago||
[dead]
remusrm 4 hours ago||
[dead]
rumburak 5 hours ago||
[dead]
epsilonic 4 hours ago||
“Life can change in a blink”

- Nathaniel, Rothschild Nov 5, 2026

gibsonf1 5 hours ago||
Its so much easier to generate code with genAI though.
dccoolgai 5 hours ago||
It's so fast. You can also put "make no mistakes" in the prompt.
sedan_baklazhan 5 hours ago||
And we can fire so many programmers now
aleqs 5 hours ago||
The degradation in software quality across the board (Spotify, Google Maps, GitHub, YouTube - to name a few) has been very noticeable for me, and I suspect AI has a lot to do with this.

The thing is - I also think AI can be used to build very high quality software. The problem, I think, is that the typical big tech/VC tech/MBA tech type company (who control most proprietary software at this point) have very little incentive to actually care about quality, and that was quite obvious even before AI.

pkulak 5 hours ago||
I remember before I started using AI (I was pretty late to the game), I assumed all the bugs and instability were because people were writing software with AI. Now that I've seen how good the code that AI writes can be (CAN be), I'm moving more to the thinking that it's from AI being used to find vulnerabilities.
SoftTalker 4 hours ago|||
I've never had AI one-shot even a 10 line script that I didn't manually revise. To be fair, it usually produces something that works, but after seeing it I'll realize that my prompt was too vague or I left out some edge case. So it's the old problem with software "it does what was asked for but not what was needed."

So I speculate that a lot of problems with AI code are just that it is accepted uncritically because it builds and doesn't have any syntax errors.

skydhash 4 hours ago||
There’s a pressure to deliver more and faster from management. So instead of using LLM to reduce the coding time and allocate more time for review, everything is scaled down and there’s even less time for review. And you’re responsible for more as teams are also scaled down.

Not really a great recipe for good code.

antupis 4 hours ago|||
It’s more that management pushes more output and with AI it’s very easy to achieve but that will create slop.
sakopov 4 hours ago|||
I think majority of companies don't know how to build safely with AI. It's just kind of handed off to engineering and mostly used as one-off chat interaction to get stuff done. Very few are building any kind of harnesses around SDLC that focus on architecture, testing, security and etc. I think we'll get there at some point, but in my experience the smaller tech players are just now on-boarding to use AI in general in any kind of capacity. We're not talking about best practices yet.
ozozozd 3 hours ago|||
Wondering if this has anything to do with the QA function being folded into the dev team in the last 15 years or so.

I always defended this, but it appears maybe we don’t have enough developers that take pride in the work they ship. LLM coding made this pretty obvious.

s__s 2 hours ago|||
It’s not lack of pride. It’s because they can’t say: “ok development is done, now I need a few days to thoroughly test this”.
aleqs 20 minutes ago|||
Engineers don't really decide what gets shipped at a typical tech company, you either ship trash when the marketing/MBA/'strategy' NPC says or they'll find someone else who will.
DIE_DIE_DIE 4 hours ago|||
> I also think AI can be used to build very high quality software.

I don't, and I think your comment is rhetorically useless because you've been bullied into making this ridiculous concession.

aleqs 4 hours ago||
bro... what model did you use to write that? or is that how you actually talk? Lol
gtowey 5 hours ago|||
IMHO the only way to build good things is to pay attention to the details. And coding agents, while greatly increasing the appearance of productivity, they are causing people to pay less attention to what they're actually producing. This is the inevitable and obvious result.

Agentic coding could be a world-changing benefit, but the current way it's being sold and used as as a cost cutting measure -- produce software faster than ever before with fewer software engineers! Get rid of those pesky experts!

pwillia7 4 hours ago|||
We're in the v1 machines screws stage where everything is worse but with a clear path to get better .... I hope
lotharcable 5 hours ago|||
It isn't a software or tool problem.

It is a C-level executive problem. With the FAA it is the agency directorship problem. Same issue.

These people, very literally, are trying to run the world with power point presentations and executive summaries drafted by sycophants. 70 years ago these people had actual experience doing actual work and trying to grow businesses and doing stuff at the ground level. Now they are given their positions through a combination of credentials, connections, and political maneuvering. None of which actually relates to how well they can or cannot run a organization.

When reality disagrees with what they get in their emails and presentations then it reality that is wrong. It is the messengers that are the problem, not their competency.

This is nothing new. But the failures in leadership compound over time, like interest to a unpaid debt. They start off with healthy growing companies and thanks to government protections and bailouts it takes decades to for these organizations to decay into total dysfunction. In the past these sorts of people would be removed and their assets reallocated to competent management through bankruptcy and competition. However that natural process is not allowed anymore.

All AI is doing is handing them more foot-guns.

They think they can do better/faster/stronger/cheaper with AI and if AI causes problems then it can just be fixed by paying for better AI. Which they assume is just right around the corner, always.

Just wait until they start to realize that it is

aleqs 3 hours ago|||
Very well put, and I think (open) AI will help competent people outcompete these clowns, which is what makes me optimistic. AI is a multiplier, but multiplying bullshit just creates more bullshit. These people are far more replaceable than competent engineers, even more so with AI.
matt3210 3 hours ago|||
broken windows
dmitrygr 5 hours ago||
Part of being sane is accepting that some tools, while being very powerful, are too easily misused to be widely distributed to those lacking proper training. This is why you cannot just go and buy 5 kilos of azithromycin
aleqs 5 hours ago|||
Ehh I don't really buy that. Who decides what tools are distributed to who and how?

Don't want to get into a political debate here but I'll say that I think that open AI models and access to them is a benefit to society, while closed, proprietary models, controlled by tech billionaires are probably net bad for society.

gilrain 4 hours ago||
> Who decides what tools are distributed to who and how?

The same people we already delegate such responsibilities to: the government; ideally, a representative one.

aleqs 4 hours ago||
> the government

Uhhhh... you mean the corrupt, baby-eating pedophiles who are owned by tech billionaires right?

Cool plan bro

Ylpertnodi 4 hours ago|||
> some tools, while being very powerful, are too easily misused to be widely distributed to those lacking proper training.

Could you define 'proper training'? I've endured plenty of fucked-up shit from so-called 'professionals/ experts/ trained people' over the last 30 years or so.

I'm currently assisting a couple of vibe-coders improve their 'too easily misused...[and] widely distributed' (available on their sites, or github) tools - I mean slop - that benefit me in ways traditional companies have no interest in. And the updates are fast (daily, mostly) and accurate because, unlike jeremy with a pretty CS degree and a nice job, these people actually give a crap' and don't have a manager to say 'you can't do that'. Also part of being sane is accepting that the cat is out of the bag and big $oftware/ tool manufacturer better get a move on. Disclosure: my interests are not critical to anything; quite the opposite, but people are learning faster and faster with Ai learning faster and faster. Who needs azithromycin if a series 1's and 0's can accomplish so much more? For good or bad.

dmitrygr 2 hours ago||
No, i cannot. If i could, i would be proposing concrete ideas. But I also understand why I cannot buy 3 kilos of plutonium or 5 kilos of antibiotics, and understand the modern ML models can do just as much damage while being more available.
vinyl7 5 hours ago|
Software is solved!
enjoyyourlife 5 hours ago|
Software is solved but not software engineering
More comments...