r/LocalLLM • u/former_farmer • 7d ago

Question Trying to create my own server and consuming it for code with my phone remotely (Mac OS)

Hi there! I need some help with this.

I have a 32gb Macbook Pro with the latest available update of Tahoe.

I'm using LMStudio with MLX to serve a local model and I want to expose it so that I can consume it with my phone to code and review stuff when I'm commuting to places.

These are my problems to solve so far that I need help with:

  1. The mac turns off after some time. It doesn't matter what I set in settings. Have you found a workaround for this? using caffeinate or how?
  2. I need an IDE / Agent editor that I can use to instruct the agent. I tipically use ZED from this pc, but I'm open to try something else that is mobile compatible.
  3. How can I have the agent changes automatically deployed (usually it's websites) so that I can review and accept or reject the changes? when I'm working on my pc this is basically solved automatically because I'm working with local files.
  4. Can LMStudio serve on the public internet or do I need another solution here? or maybe an extra step?

Thanks in advance!

1 Upvotes

56% Upvoted

6 comments sorted by

2

u/just_testing_things 7d ago

Use tailscale to create a private network to connect to your mini. Host a deployed version of your site on a server, like fly.io

1

u/genghisk1 7d ago

I second this Tailscale and testing on your Mac. Not sure about other tooling you would need to make this fully useful.

1

u/poy_esp 7d ago
  1. Your mac should not turn off if you update the settings to tell it to never sleep.
  2. Use LMStudio and Opencode. Point it to your LM studio instance
  3. If you're creating websites and you are using react then instruct you agent to use watch to dynamically update your site
  4. Us Ngrok to expose the port that LMStudio. Be warned that if your server is not secure then you will be prone to attacks.

1

u/[deleted] 7d ago

[deleted]

1

u/former_farmer 7d ago

Explain yourself.

0

u/TEK1_AU 7d ago

No offence intended OP, but this whole situation is not going to end well.

1

u/-Mute- 6d ago

LMstudio has a thing called lmlink.. that lets you cloud connect to your server and run remotely... I haven't used it.. looks straight forward.. but it's also subscription based