Top
Best
New

Posted by MattIPv4 13 hours ago

GitHub is once again down(www.githubstatus.com)
354 points | 189 commentspage 5
lousken 10 hours ago|
Github CEO must be on HN, right? If so, any comments?

They have not even bothered to implement entra login when they have their competitors login for years, do they even know what their product is? Or are you just a middle man for slop?

nomilk 9 hours ago||
Why don't companies with chronic outages mimic their stack from top to bottom (i.e. starting with a new domain), then before making a change, make the change on the duplicate stack and blast it with mock requests.

Might catch 90% of problems before they make it into the real stack?

E.g. every step of GitHub's migration to Azure could be mimicked on the duplicate stack before it's implemented on the primary stack. Is this just considered too much work? (I doubt cost would be the issue, because even if it costs millions, it would pay for itself in reduced reputational damage from outages).

EDIT: downvotes - why? - I think this is a good idea (I'd do it for my sites if outages were an issue).

hedora 5 hours ago||
Downvotes are probably because that is what companies without chronic outages do.

If you'd ever worked on a codebase as terrible as I imagine GH's internals are and looked at the git history, you'd find two things:

1) fixing it would require rolling back 100's-1000's of engineer-years of idiocy that make things like testing or refactoring untenable

2) many prior engineers got part of the way through such improvements before leaving or being kicked out. Their efforts mostly just made it worse, because now you never know what sort of terribleness to expect when you open an unfamiliar file.

drewbug01 8 hours ago|||
> EDIT: downvotes - why? - I think this is a good idea (I'd do it for my sites if outages were an issue).

Because that's a monumental amount of work, and extraordinarily difficult to retrofit into a system that wasn't initially designed that way. Not to mention the unstated requirement of mirroring traffic to actually exercise that system (given the tendency of bugs to not show up until something actually uses the system).

nomilk 8 hours ago||
> that's a monumental amount of work

Agree, but look at the alternative; GitHub is constantly being savaged by users who (quite reasonably) expect uptime. Ignoring impacts on morale and reputation, damage to their bottom line alone might tens (hundreds?) of millions per year.

> mirroring traffic

yeah, I agree that's difficult, but it need to not be exact to still be useful.

worik 9 hours ago||
Testing? Who needs it when you have Copilot!
pbkompasz 12 hours ago||
Vibe check?
cyanydeez 11 hours ago||
That's just like your Vibe man; can you just copilot your wayout of these problems?
ransom1538 11 hours ago||
Did MS finish the Hotmail transition?
duped 12 hours ago||
Does github not do any kind of blue/green rollouts or what
GiorgioG 12 hours ago||
I'm going to blame Claude Code!
rdedev 12 hours ago||
My vscode slop session stopped in between. Maybe it's for the better
wrqvrwvq 9 hours ago|
"the food is terrible and such small portions!"
olivia-banks 12 hours ago|
At least it happened after I did my work for the day... jfc!
More comments...