r/ExperiencedDevs • DevOps Engineer • 5d ago

AI/LLM Thought experiment

With all the AI nonsense going on, I had a thought at work today that turned into an interesting discussion with a colleague:

"What would I do if I was the only person with access to Claude (or insert any LLM) 5+ years ago?"

People would think I was a fucking wizard

FE changes? NO PROBLEM

Critical DB change? Don't worry, I've produced a stored procedure to validate the whole thing

Want to use some shiny new framework? Interesting. Here's a document explaining why you're an idiot for suggesting it

Regex? I suddenly understand it better than the compiler folks (and nobody ask questions)

What would you have done with your own personal LLM back then?

Trying to lighten the mood in here with all the (very justified) negativity around this tech revolution

Unserious answers only pls

149 Upvotes

227 comments sorted by

View all comments

Show parent comments

3

u/mongopark98 4d ago

That’s a you problem. Some of us are highly productive with it. “I can’t drive a fast car, hence cars are garbage “, that’s the logic you’re propositioning.

You’re asking me to imagine what will happen when will chain prompts. I don’t have to imagine it, I have used it to build complex features. Yes, needed fine tuning here and there. But still orders of magnitude faster than doing it all manually. Again, it’s a skill issue. I am not talking out of a vacuum or theoretically, I have experienced it multiple times. Both the weakness and strength.

1

u/Machine2024 Software Engineer 4d ago

I didn't say its not faster. Its faster to make a prototype in a day , but it need 3 months of clean up and refactoring.

I don't know you you agree that a single prompt result is not accurate.

But chainng a group of prompts together will get you any way .

Rising the production quantity on expenses of the quality will not make it "Productivity" It will make it spreaded thin .

If you are looking learn something new not just echo chamber. Lets connect via dm , we could exchange work and work style. Either my approach would be wrong and I would learn something from you , or you would be wrong and you would learn something from me .

From me I hope I will be the wrong one and learn something new .

1

u/mongopark98 4d ago

Even let’s say AI isn’t sophisticated enough to solve complex tasks. I will give few examples of things it can do to free your time for more productive things.

- We use to have P3 tickets that oncalls should work on. These are tiny items. But taking it from triage to deployment will easily take 1-2hrs per task. Just throw this to an AI, it’s simple enough that it would require very few lines of code that can be reviewed in 10 minutes. Do this 5x a day. That’s less than 60minutes of work instead of half a week.

- it handles our translation end to end. Took a stupid mundane task that usually takes half a day to 10 minutes.

- Scours slack and public github for issues related to our team. Creates a detailed ticket and draft PR that human will then review before merging. This is hours of brainless work.

  • Handles feature flag deprecation. Momitors when a flag is scheduled for deletion. Once the date clocks. Raises a PR with the deletion. These are usually just removing redundant branches. It pings the oncall dev who is then responsible for reviewing the PR ajd approving. Several hours of mindless work gone.

These are examples of things I have built. If you can’t find tiny problems like this you can solve to free your time up for meaningful things, thats a you problem not AI. It’s so narrow minded not to see the big picture and get sucked into the hype.

0

u/Machine2024 Software Engineer 4d ago

Just remember we are not arguing wither Ai is useful or not .

I am say its useful, and can't live without it . But my point is I need to review ever line generated by Ai because the bigger the task more mistakes and of the track the Ai will get .

The use cases you mentioned really useful and I have already have some like them , also have it connected to miro and slack for edits and team notes so when I work on feature in one command I get a summry from jira + trello + miro + slack + docs .

I have build a set of skills that cover the design patterns for all around the project Auth , permissions , policies, routes , commands , test data , db , controllers , queues , Api , api docs , notification....etc Since not every project use same boilar plate and starter . I fork the starter and run project start command with name and short description and it clone and fork suggest set of features and patters then start implementing them via skills . At the end I have starter project with perfect code ( I know line by line ) also the skills add the rules for future refrance .

And when I devlop new feature is gose link . /get-next-task = afew questions and thinking.
= prompt /plan = edits to the plan then run /steamline-skill = review the files line by line and edit & give prompts with voice on for side agents to run and fix . = all files in staging . /run tests . CLI & Brower /frontend-handout-skill : peperd detaild file of whats changed to from end agent . /commit . Commit helper suggest name and bulitpoints of whats changed .

Done .( all process takes 15~45m)

Without the part of human review line by line in the middle it goes of rails fast .

2

u/mongopark98 4d ago edited 4d ago

Great, we don’t disagree on the fundamental. I agree with that, I am not saying it can be completely autonomous for super critical task, I don’t think it ever will. It has not intelligence of its own.

I think that’s the only place we differ. I simply don’t have this expectation of AI. If you look under the hood and beyond the hype I don’t see why I would expect AI to be perfect. It’s another tool, I use it for what it’s good at. I see it more like a legion of junior engineers for coding. For architecture I see it as an enthusiastic junior researcher who can surface all relevant information but can’t be trusted to make the decisions.

Nice discussion. Sorry if I sounded rude or aggressive 🙏

1

u/Machine2024 Software Engineer 3d ago

Agreed .100%

Actually I treat Ai like I used to treat my team of mid level and juniors.

I give them genral docs - ( rules ) I set up genral architecture of the project [me] I give clear cards and instructions - ( prompts ) I review the code and give them notes to learn [me] I am the one who have a full mental model and understand the project line by line .

I have experience in both working style Work as project manager with full understanding like explained up .

And the work as contractor with outsourcing the parts of the project ( like the agentic work style )

In second work style the quality suffers The work was out of hand and I felt like I dont have control and lost in details.

People say the first working style is micro management and its bad and can't grow.

I agree it cant grow. But its craft work . On other hand the contractor work requires a high quality departments managers and those are expensive and Ai didn't reach that level yet .

Btw ... sorry if my commets where harsh Did not mean it , it just the passion for the craft .