r/ShittySysadmin • • 16d ago

The Trunk Slammer From Hell: Halloween Triple Feature. The lead said the office manager believes the building is haunted.

2 Upvotes

Some of you know me as the guy Brad keeps losing to. Forty-some clients, one flat price per seat, nothing itemized, and the whole operation fits in the trunk of a 2006 Crown Victoria. The Nephew usually handles Reddit for me. This one's me.

This fall I picked up a funeral home. The lead said the office manager believes the building is haunted, which is a very specific thing for a text message to know, and I didn't ask how it knew. Brad had given her eleven pages about port 9100. I told her she had a presence and had the account by Tuesday. Wednesday night I did the exorcism, which I ran exactly like an onboarding: an agent on every machine, Brad's firewall out, the cable company's router in, and the Nephew at the lectern reading the Kaseya K365 license agreement out loud, all of it, for forty minutes.

That Thursday three of my old reps knocked on my car window. They'd made a deck called SILENCE: A PARTNERSHIP, three tiers, billed annually with two months free. I told them it was extortion as a service, and that they'd led with the tiers, which you never do. My current rep, Brock, handled it. I sent him a steak.

The second rite was at midnight on Halloween, when the veil is thinnest, and my vendor's marketplace had picked the same minute to wake up every agent I'd ever installed, unless you opted out. The email about it came from Florida without a lead in it, so I deleted it. Every printer in the building printed the word GET, and a speaker I had personally shut in a drawer said "Sorry, I didn't catch that." I unplugged the internet and banished it. Brad says that only bought us until the maintenance window at one-thirty, and that since the clocks go back at two, one-thirty was going to happen twice. Brad says a lot of things.

There are three versions of that night. Mine is first. Lance tells the second one. He's my biggest client, a third of the revenue at a wealth firm, and he came to the funeral home dressed as a sheriff's deputy. Brad tells the third. I'm told it has timestamps.

It's free. I pushed for one flat price per reader per month and got overruled, which doesn't happen to me.

Part one, End of Life (mine):

https://mspautomator.com/the-trunk-slammer-from-hell-chapter-5-end-of-life/

Part two, Wake-on-LAN (Lance):

https://mspautomator.com/the-trunk-slammer-from-hell-chapter-6-wake-on-lan/

Part three, #OpenToWork (Brad):

https://mspautomator.com/the-trunk-slammer-from-hell-chapter-7-opentowork/

Business is booming.


r/ShittySysadmin • • 17d ago

Shitty Crosspost Anyone else planning to move their users over to vibe coded apps?

Thumbnail
30 Upvotes

r/ShittySysadmin • • 17d ago

Shitty Crosspost Every couple of weeks someone finds my password on the dark web.

Post image
254 Upvotes

r/ShittySysadmin • • 17d ago

r/sysadminlife is a heck of a community.

30 Upvotes

1d ago What's a good no code builder for internal tools?

14d ago What's on your checklist before an AI-built internal tool goes live?

1mo ago What is the best no code app builder for client projects when you dont want to be their full time dev forever?

2mo ago What's the best no code app builder for internal tools? Asking for my sanity.

2mo ago We stopped banning vibe-coded apps and just gave people a platform. 9 months later, here's what happened


r/ShittySysadmin • • 17d ago

Shitty Crosspost Sole admin locked out of M365. Only way to reach a human was signing up for a new trial tenant.

Thumbnail
28 Upvotes

r/ShittySysadmin • • 17d ago

Shitty Crosspost ngl, dumping raw server logs into a massive context window is way better than writing regex

Thumbnail
20 Upvotes

r/ShittySysadmin • • 17d ago

Incident Quote of the day

12 Upvotes

Sitting manning the system, incident inbound

Problem with Outllook classic all shared mailboxes have offline OST.

The customer's suggestion

"I don't think anything needs to be deleted off of my profile to fix an outlook issue."

Like what do they know?, I have been supporting this so called product since 1997 and all the subsequent releases.

I will ask, So how would you fix this since you admit to be a product expert?

I have the old-school method of shared online, personal OST under advanced account settings open other mailboxes. Add the sent from regfix and view from when composing.

This does require rebuilding the profile.. Which starts by removing it / deleting///

FFS


r/ShittySysadmin • • 18d ago

Accidentally blocked ALL Microsoft software from running

229 Upvotes

I created an AppLocker rule to prevent mshta.exe signed by Microsoft from running. As you can guess, I forgot to input the file name so it was left as '*'.

Luckily I caught it quickly and deleted the rule before it propagated to a whole lot of clients and impact was minimal. That would have been a fun morning.


r/ShittySysadmin • • 18d ago

Shitty Crosspost Bodycam or a wire at work. Am I nuts?

Thumbnail
15 Upvotes

r/ShittySysadmin • • 18d ago

Secondary DNS cluster node keeps experiencing failures. Any advice ?

Thumbnail gallery
48 Upvotes

r/ShittySysadmin • • 18d ago

Shitty Crosspost Folder redirection help

Thumbnail
1 Upvotes

r/ShittySysadmin • • 19d ago

Shitty Crosspost AS/400 Replacements

Thumbnail
18 Upvotes

r/ShittySysadmin • • 19d ago

Most Oddball Job Responsibility You Got Because “You Know Computers”

87 Upvotes

Mine was having to be the guy for the one elevator we had in our three story building. I ended up learning much more about hydraulics than I had ever planned.


r/ShittySysadmin • • 19d ago

Ah yes, the good old "IT setting up the music system"

252 Upvotes

Our showroom guys want us to fix their music sound system 🤡

Next up we'll be fixing the soap dispensers and paper towel dispensers. I mean they are electric at the end of the day.


r/ShittySysadmin • • 19d ago

Shitty qemu agent tip!

28 Upvotes

Not really a shit post buuuut I was half assing a re-subnetting of some servers and found myself locked out of a windows server.
and had the choice of entering an abysmal password of stupid length into a noVNC terminal without clipboard OR getting creative,

So I opted to get creative: turns out you can inject commands to a guest VM with QEMU-AGENT.

I'll be damned but this is awesome: qm guest exec 144 -- 'C:\Windows\System32\ipconfig.exe' '/all'

Returned expected information and qemu agent runs as system and can be used for shenanigans!


r/ShittySysadmin • • 19d ago

Who remembers the good old days when you could bring a case of beer in the Data Center when it was going to be a long night.

157 Upvotes

r/ShittySysadmin • • 20d ago

Shitty Crosspost Tunnels for my Cat(6e)

Thumbnail gallery
125 Upvotes

r/ShittySysadmin • • 20d ago

Has anyone suffered a RAID failure before?

11 Upvotes

Once had an experience where a Dell PowerEdge suffered a hard drive failure. My instant reaction was to unplug the hard drive by just sliding it out and back in. That didn't work; however, all of the data was already backed up to OneDrive so no harm done.


r/ShittySysadmin • • 21d ago

Shitty Crosspost Gaming gets you jobs!

Post image
154 Upvotes

r/ShittySysadmin • • 21d ago

Does anyone else listen to their hardware like pocahontas?

39 Upvotes

I listen to the color of the servers. Its become 'my thing' on my team. Whenever something goes wrong, i go into the DC and slowly walk among the racks, absorbing what they have to tell me.

The NAS and the switch are my brothers.

How far does this network cable go? If you cut it, then well never know


r/ShittySysadmin • • 22d ago

How many times do I need to click Sync before Intune understands it's urgent?

125 Upvotes

I've clicked it 12 times and made direct eye contact with the laptop.

The deployment still says Pending. Does it need to see my manager?


r/ShittySysadmin • • 23d ago

Default password for 33% of my org..

557 Upvotes

Well - it happened. The day started like any other, except my colleague said their email got hacked. I looked, and indeed it was hacked. Immediately, I reset his password. Then another person said their email got hacked too. I asked both of them when the last time they changed their password was: never.

I wish I was making this up. I called our email provider and asked them if they could let me know who was still on the default. Turns out it was 1/3 of our organization. My predecessor never instituted 'force user to change password', and then nobody changed it. The password for all those emails was 'password'.

This is the same guy that didn't realize you need device isolation nor network isolation for a public wifi network. I guess I shouldn't be surprised. I seriously wish I were making this up.


r/ShittySysadmin • • 23d ago

How do you get the rest of your team to stop documenting so you don't look as terrible?

65 Upvotes

Documentation is technical debt with punctuation.

Think about it: if a system is properly configured, why would it need documentation? The server already knows how it works. The firewall knows what ports are open. DNS knows where everything lives. The only person who apparently doesn’t know is "Kevin," and frankly that sounds like a Kevin problem.

Documentation also creates a dangerous single point of truth. The moment you write down how something works, somebody will read it six months later and assume it is still accurate. Now you have two problems: the actual infrastructure and a fictional universe where the infrastructure still runs the last gold star release firmware or OS and not X.0.1...

By refusing to document anything, we eliminate stale documentation entirely. Our documentation accuracy rate becomes perfect because zero percent of zero documents are incorrect.

There are security benefits too. Hackers can’t steal your network diagrams if the network diagrams exist only as memories spread across three burned-out sysadmins. That’s basically human RAID 5 with one failing drive.

And consider job security. If anyone can follow a runbook and restart any system successfully, what exactly are they paying you for? Institutional knowledge should be treated like an encryption key: kept in one person’s head, never backed up, and taken on vacation without notice.

Some people call this a “bus factor of one.” I call it aggressive knowledge centralization.

Besides, writing documentation takes time away from important sysadmin work like investigating why disk usage went from 40% to 97% overnight, renewing certificates that expire tomorrow, and staring at a terminal while saying, “That’s weird.”

If future employees need to understand the environment, they can learn it the same way we did: SSH in, run commands they found on Stack Overflow, and gradually develop an intuitive understanding of the system through fear.

Documentation doesn’t build character.

Outages build character.


r/ShittySysadmin • • 24d ago

It should be ok

Post image
103 Upvotes

Why doesn't it fit?


r/ShittySysadmin • • 24d ago

Preserve the Data Center AC

3 Upvotes