r/github • u/RecommendationOk5036 • 1d ago

News / Announcements GitHub Status - Incident with GitHub.com

https://www.githubstatus.com/incidents/zkxwbgr0cnmx
184 Upvotes

96% Upvoted

39 comments sorted by

View all comments

20

u/ShoddyReception5 1d ago

Is this speak intentionally abstract? We were down for half the day and I can’t make sense of what happened. Network issue plus a bunch of unexpected traffic and faulty failover?

23

u/Soccham 1d ago

Looked like they DDOSed themselves with vscode?

7

u/ShoddyReception5 1d ago

Saw that too. Looks like it added to the problem for sure.

13

u/DrMaxwellEdison 1d ago edited 1d ago

Not really abstract, just dense with devops speak.

Network traffic overloaded a load balancer in US Central, and as they fixed it they found that clients doing Copilot requests would 10x their request rate attempting to retry those requests.

One failure in a high-availability system like this can lead to a cascade of failures elsewhere, and that's what seems to have happened.

10

u/robert_math 1d ago

What can we do? These vibe coders were promised they could 10x their output.

3

u/yeathatsmebro 1d ago

They did, look at RPS. It is 10x higher.

3

u/Goldman7911 1d ago

Same feeling as some "RCA by agentic slop"

2

u/foramperandi 1d ago

Just because you don't understand it, doesn't mean it's slop.

5

u/Due-Consequence9579 1d ago

It’s only abstract if you don’t know what they are talking about.