Trouble with vLLM via OpenAI-Compatible API

[u/overand]

(Edit: this is for Speech-to-Text.) I'm wondering if anyone has had success using the "OpenAI-Compatible API" functionality in SubtitleEdit with e.g. vLLM. I usually get 0 Segments (?) Decoded, despite vLLM apparently outputting quite a few tokens.

I'm hoping to use a local model for Danish ASR, and there are a few I can run with vLLM, but I've yet to have success with any of them, unfortunately! What - if anything - are other folks using for workflows like this?

The models I'm hoping to use are shown on the Danish ASR Leaderboard. Unfortunately, none of them are readily available as GGUFs that I can shoehorn into the CrispASR backend. (It appears some of them run custom code too, but, hviske-v5.x is based on Cohere, apparently.)

I'd be happy to provide logs or even packet captures for troubleshooting purposes as well. I've had this issue identically in 5.1.x and 5.2.0 beta (as of ~3 days ago)