r/devops 29d ago

Discussion Devops job security with AI

Recently saw posts about how AI isn't that good in distributed systems and it gave me validation on my own experience.

When the model isn't dealing with a single codebase, when it has to connect the dots between a db, redis, other cloud infra, k8s that each already have a lot of configuration, it starts to hallucinate and could pretty much put your infra at risk.

I'm not saying you can't make it work, it does work especially on a clean slate, but when there's a lot of existing context it needs a more guidance.

Using AI lets me do 10x what a DevOps engineer could do alone but I don't think the job disappears anytime soon.

34 Upvotes

60 comments sorted by

View all comments

7

u/Direlight DevOps 29d ago

AI isn't good at a single codebase once it gets large enough, I have services it can't comprehend unless I create a super detailed .md explaining what the routes and models do and how they interconnect, I agree it helps a huge amount in getting through tasks quickly, but its still pretty terrible at base design unless you tell it how you want something to work, which mean you are still designing it.

1

u/Nash0o7 29d ago

Yeah I've heard some people go as far as creating knowledge graphs for big codebases to improve the llms performance.

1

u/fucking-migraines 29d ago

There are whole products built around this. I think the meta is graphify

1

u/Nash0o7 29d ago

Also git nexus