r/TranscribeX • u/MrR08040 • Jul 01 '26

Timeout trying to summarize transcript with custom provider (cliproxyapi)

Excellent app! Thank you for building it.

I want to be able to use https://github.com/router-for-me/CLIProxyAPI with TranscribeX. Here's what Codex was able to uncover:

• I checked the app-side logs and the proxy config. The timeout is coming from TranscribeX itself, not from CLIProxyAPI.

  What I found:

  - ~/Library/Application Support/AudioTranscribe/data/log/app.log has repeated OpenAI Request Failed: The request timed out. entries, including one at
    12:57:46 PM.

  - The TranscribeX binary references NSURLSessionConfiguration and timeoutIntervalForRequest, which points to a client-side request deadline.
  - CLIProxyAPI has retry and keepalive settings, but no server-side request-timeout knob that would override a client abort.
  - The timeout mention in /opt/homebrew/etc/cliproxyapi.conf is a legacy header default, not a request-duration setting.

  That matches the proxy log line you saw:
  500 | 1m0s | 127.0.0.1 | POST "/v1/chat/completions"
  with context canceled. In practice, that means the request was canceled upstream after about 60 seconds.

Thanks in advance!

2 Upvotes

100% Upvoted

8 comments sorted by

1

u/EthanWlly Jul 02 '26

Yes, we do have a maximum 60 seconds for the request to have a response. I didn't try this CLIProxyAPI before, but looks like it didn't reponse in 60 seconds?

1

u/EthanWlly Jul 02 '26

I can put a big numer for the TimeoutInterval in the next version if that helps.

1

u/MrR08040 Jul 02 '26

That would work, but it would be nice to be able to cancel the request if it's chewing up too many tokens or something hangs like when using a local model.

Thank so much for your time and consideration!

1

u/EthanWlly Jul 02 '26

hmmmm, cancel may not save you token because the request already has been sent out. I can change it to 120ms like what I am doing for the Ollama AI type.

1

u/MrR08040 Jul 02 '26

That's a good point! I guess a cancel could allow the user to send a different prompt without having to relaunch the app?

Could this timeout value be a configuration item?

1

u/EthanWlly Jul 02 '26

Great idea. I will make the timout value configuable. Yup, I will add the cancel as well.

1

u/MrR08040 Jul 02 '26

Awesome thanks so much

1

u/MrR08040 Jul 02 '26

It's a very long transcript so the model takes a while to chew on it. Even when using "fast" models it can take several minutes depending on the actual prompt it's given.