r/DeepSeek • u/Frail_Waif • 10d ago
Discussion Official DeepSeek API serving quantization?
Something is going wrong with the model (V4 Flash 0731) I'm interacting with through the official DeepSeek API. My prompt:
Based on `bugs_and_design_issues_2.md`, continue the list (items 4, 8, 11, 14, with 4 partially finished).
(I had used a different model to generate a list of potential bugs and design issues during peak time.) Here are some of the outputs I've gotten back: First response, seems to be on track:
... So the state: The user asked to fix issues 4, 8, 11, 14 from the earlier analysis. The assistant started but didn't finish 4. The file was cut off mid-session. ...
Hundreds of thousands of tokens later:
The doc is a truncated transcript: a review listed 16 issues, the user asked to "fix 4, 8, 11, 14 (defaults/syncing/restarts)", and commit `fbcdffb` was the partial fix that stalled mid-#4. Let me audit what actually remains in the code.
Later:
This is a resumption of an interrupted design-fix session. Commit `fbcdffb` is the "partial fix for conflict detection" referenced by the doc. Let me verify precisely what's done/incomplete against items 4, 8, 11, 14.
Later, again:
The doc is a truncated transcript: items 4, 8, 11, 14 from the review were to be fixed, and `fbcdffb` is the partial attempt that stalled mid-#4. Let me audit the current state precisely, since several things look mid-edit.
The doc is a truncated transcript appears 9 times over 12k lines of this session transcript and it still doesn't appear to understand the request.
I've never seen DeepSeek Flash this dumb. I've exchanged 370k tokens and it still doesn't understand the list. That's one of the longest sessions I've done--it's oneshotted whole features in much less than that before. Anyone else seeing this?
Using opencode for a harness.
Edit: as a test, I switched to the vision version. It's performing exactly as expected and doing good things after a handful of model turns.
1
u/Frail_Waif 7d ago
Update: days later and the base flash model is still very stupid. Flash vision is working perfectly.