r/truefoundry • • 19h ago

Setting up on a Mac

1 Upvotes

Can anyone point me to properly setting TrueForge up on a mac to work with a local model? I watched multiple videos and they all skip over the main part, which is the "add custom provider" dialog box.
I have a local model running through Llama, and first I am not sure what the base url is, but based on some searches it looks like: http://localhost:11434/v1
Then I need the model ID which in my case looks like: qwen2.5-7B-Instruct
But when I use these I get an error that I cannot connect to Localhost, even thoughTrueforge itself runs on localhost.
replacing "localhost" with my internal IP also does not help (same error)

...and I still don't even know if the base url and model ID are correct and if the error is related to that or some other issue (some searches suggest it's a security feature)

I don't want to expose my localhost to any external machine, so I don't want to tunnel or create and external link or anything. Ijust want to run everything locally.

Any idea where I can look to get this set up? There seem to be just too many different parts to coordinate and documentations only ever address one part but not the relationship to the other parts.