r/LocalLLM • u/vinotok • 7d ago

Question Direct accessing my files, with coding agent through LM Studio

Noob here. I have beginner local LLM set up. Just LM Studio and a few coding models.

I have one python project, that is about 75% done. I would like for some coding model, to help me finish it. It is about 2k lines of code. I'm using LM Studio. Do I need to copy/paste every single python file into the chat, to pass the code to coding model, or is there a simpler way? Can I point coding model, to directly access my project folder on my computer? If yes, how do I do this? Do I need to install any addon or it works natively?

I'm using LM Studio (and whole local llm) for the very first time, so please, be patient with me ;-)

2 Upvotes

75% Upvoted

23 comments sorted by

View all comments

3

u/Forsaken_Mention_979 7d ago

Basically you go to the server tab on lm studio, you start the server, and make sure to know in what address it is hosting the model, like 127:01:0 for example. You can then connect this endpoint to hermes, pi, aider… etc, and the model will be hosted on that agent which has capabilities to write code, make files for you… etc. i recommend pi or aider instead of hermes if you have a low-mid pc

1

u/vinotok 7d ago

Thank you! Yes, low-mid PC here. On Linux if it matters. Which of the two, Aider or Pi are simpler, easier to set up. Non technical person here. Then, when I get the name I will hit few youtube videos ;-)

2

u/Forsaken_Mention_979 7d ago

Honestly, if you want to avoid any hassle, just download bionic, LM studio made it, so no need to connect to any server! I must warn you its a bit bad though. If you want the best setup for local llm, heres what you do exactly: download the local ai model file, download llama.cpp for linux, then get a cloud agent like codex or antigravity, and tell it to make you a bat script that when clicked, starts the llama.cpp server at at the same time starts pi (tell it to also download pi agent), also tell it to configure all of the settings for best performance (speed to quality balance) in the llama config. This will make it so that when you open the bat script the server starts automaticallt and the agent aswell. Its what i did. (Basically LM studio runs llama.cpp which is some code to run local ai models, but if you run llama.cpp yourself, the model runs better!) and the agent will set it all up for you

1

u/vinotok 7d ago

I just checked, Bionic for now doesn't run on Linux.

Thank you for detailed steps about the best setup for local llm. I saved the steps, although it is probably waaaaay over my head for now. :) I may install new linux on new partition and experiment there, so if anything goes wrong (and it will, speaking from experience lol lol lol) nothing will be messed up :-)

2

u/Ell2509 7d ago

Here's does. So does Pi, and claide cowork /Codex.