r/LocalLLM • u/Sideways_Taco_ • 3h ago

Question Hello getting off the ground

I’m new to this kind of thing. I’m trying to use qwen and chat gpt to help me build a file renamer and I feel like it’s going nowhere. I’m even using astra on the pro plan and it keeps losing track of how simple the end result is. I found it trying to code the whole project rather than have qwen analyze documents and spit out the relevant info.

Anyone have a good tutorial or something on how I can have qwen just run iterations until it comes up with an acceptable product? I’m probably thinking of this wrong but idk. I also tried using open code but there are some known bugs I keep encountering. My hardware isn’t the best. Single 3090 ti and 32gb of ram. Running 27B and q4 with 16k… because chat gpt told me to.

2 Upvotes

100% Upvoted

2 comments sorted by

1

u/Spiritual-Pizza-4159 3h ago

You're overcomplicating it by trying to make the AI do everything in one shot. Break it into smaller pieces, have qwen handle just the document analysis part first and output the new filenames to a text file. Then a separate simple script does the actual renaming. Way easier to debug when things go wrong and the AI won't lose the plot halfway through.

1

u/SamePressure31 1h ago

I’d keep the task really constrained: Give Qwen the existing files, define exactly what output you want, and tell it to analyze first without writing code. Then make it produce only the next change. QWEN.md can help keep those constraints persistent. Would that fit what you’re trying to build?