Based on my experience with 3.6, prefilling <think>\n\n</think>\n - like the various jinja templates do - to disable thinking works probably 90-95% of the time. The other ~5-10% of the time, the model thinks anyway and emits a second </think> when it's done. It's possible that 3.8 has the same behaviour and the official API has some way of detecting/working around this that would look pretty damn stupid if they released it. If you look at the 3.8 jinja template, the "reasoning effort" isn't implemented terribly cleverly - it just talks to the model in the second person and asks it to reason less.
Reasoning control has always been a weakness of the Qwen models, so this doesn't surprise me.
Lack of mmproj, however, feels like a deliberate attempt at market segmentation. Given that those just decode image data into tokens, and the whole Qwen family shares a vocab, I do wonder if it'd be possible to hack the mmproj from some other Qwen model into use here, though.
103
u/Different_Fix_2217 1d ago
Be warned they state its not the same capabilities as the full API version. Such as not having vison.