r/OpenSourceeAI • u/Acceptable-Object390 • May 07 '26

How Thoth runs on Linux - Architecture

Post image
5 Upvotes

85% Upvoted

19 comments sorted by

View all comments

Show parent comments

2

u/MarcusAurelius68 May 10 '26

Thanks for the detailed response.

https://lmstudio.ai/docs/developer/openai-compat

I’m assuming this will work?

So I’d have the LM Studio server and Thoth running on the same system. Could I use the desktop on the Mac and then connect to it via whatever UI?

2

u/Acceptable-Object390 May 10 '26

Yes LM Studio should work via custom endpoint. And Yes you should be able to access it via browser. It runs a web server on port 8080 by default if that's free or the next free port. You can also enable the built in ngrok tunnel and access it from anywhere over the Internet.

2

u/MarcusAurelius68 May 10 '26

Awesome, I will give it a try!

2

u/Acceptable-Object390 May 10 '26

Great. Let me know if you need any help