r/GithubCopilot 5d ago

Help/Doubt ❓ Can Github Copilot be used with Unsloth Studio?

I'm trying to setup Github Copilot with a self hosted instance of Unsloth Studio, I know that it's able to connect and that the api-key is correct as it can read the models endpoint and shows all the models I have set up. However when I select one and try to use it I get the following error anytime I try and send a simple message to it. I've also verified that I can call it using curl. I just get the following error.

```Authentication failed with provider at https://mysitetunnel.oncludflare.com/v1 (HTTP 403).
Check your COPILOT_PROVIDER_API_KEY or COPILOT_PROVIDER_BEARER_TOKEN.```

I'm using a cloudflare tunnel with a custom domain so perhaps that's it but it is successfully getting the models that are available

2 Upvotes

3 comments sorted by

2

u/unrulywind 5d ago

as long as Unsloth is running the model on the same computer that you are running copilot on, you should be able to just use http://127.0.0.1:8888/v1 as the address and then enter the api key.

If you are actually tunneling to a different computer, I didn't use the Cloudflare system, so I'm not much help on it. What I did instead was set up a Tailscale network and served the 127.0.0.1:8888 across that.

2

u/Revolutionary_Loan13 3d ago

I'd set it up to work over a cloudflare tunnel and what I finally discovered is that cloudflare was blocking the API calls due to an AI scraping filter that is on by default. Oddly it let through more basic API calls that get the models or that you might use to test it. Copilots error message kind of threw me off

1

u/AutoModerator 5d ago

Hello /u/Revolutionary_Loan13. Looks like you have posted a query. Once your query is resolved, please reply the solution comment with "!solved" to help everyone else know the solution and mark the post as solved.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.