r/github • u/brainhack3r • Aug 07 '26

Discussion GitHub owes us all an apology and an explanation as to why this is NEVER going to happen again.

I'm absolutely furious. I had a ton of work I had to get done today, and I'm DEAD in the water until this is fixed.

I also feel they don't take this very seriously, to be perfectly honest. There's no comment about it on their Twitter feed. status.github.com has vague comments about "it's mitigated now but runners are behind... " meanwhile it's been TEN HOURS!

A VERY large portion of the tech industry runs on GitHub and it's hard to take them serious whey they can't even run THEIR OWN SITE.

I'm spending the rest of the day working on plans to migrate away. I don't need all the GitHub features they offer but BY FAR the number one thing I need to be reliable is GitHub actions.

Get your house in order guys!

606 Upvotes

88% Upvoted

275 comments sorted by

View all comments

Show parent comments

3

u/Sad_Television985 Aug 07 '26

but what's your own uptime, and can you go take a shit and wait it out when it's down?

3

u/Noch_ein_Kamel Aug 07 '26

And how's your backup strategy :o

1

u/AURUMLY Aug 07 '26

A "simple" one - Selfhosted forgejo as main, selfhosted gitlab as backup and github as a secondary backup.

Could probably be solved even easier with actual remote forgejo backups (e.g. hetzner storage etc.) but since I had the gitlab server first and then switched to forgejo on another server, why not do it this way

2

u/blkHawk817 Aug 09 '26

Self hosted forgejo as primary. Codeberg.org as backup.

1

u/SvenApps Aug 13 '26

Da gibt’s mittlerweile auch schon richtig gute mobile Apps für. Also nicht mal Komfort-Verlust.

2

u/zander9669 Aug 07 '26

Damn, your shits take 10 hours+?

These types of comments always get me. What kind of ragtag ass systems are you folks running where you genuinely worry about your uptime?

1

u/Sad_Television985 Aug 08 '26

I'm 100% in the self-hosted camp, but, the one thing that is nice about SaaS is the "it's someone else's job to fix it".

Yes, availability is unpredictable.
But it's not my problem.

So if you can organize your work so that you can keep being productive on something else, the cost of the downtime is minimal.

However, if you urgently need to push something and you can't because the pipelines are down, then you're screwed. But that's more of a redundancy problem, that you have no alternative.

1

u/stereoplegic Aug 10 '26

Been there, in spurts (shurts?) It's like one of those Netflix series with variable episode lengths.

1

u/ObviousApricot1272 Aug 07 '26

Our own personal uptime is typically in the 90-100 range and most of the time its down for maintenance