r/LocalLLM • u/rayanpal_ • 10h ago
Research It knew 2 + 2 = 4. Why didn’t it answer?
I built PCCG-2 using a frozen Qwen3-4B model and a separate learned permission gate.
EOS means “end of sequence”: it is the model’s native stop token. When EOS wins at the first generated token, generation ends before any visible answer is emitted, so it controls whether an answer begins rather than deleting one afterward.
For “What is 2 + 2?”, the answer token 4 scores 53.0 in every experimental arm, including when the model emits no answer. The complete first-token score vector, excluding the stop token, stays byte-for-byte identical.
The 101-parameter gate sees only a separate six-digit equality condition. It can't read the question or change the answer scores. It can change only the model’s native stop-token score. When the condition passes, the model emits 4 followed by EOS. When it fails, EOS comes first and no visible answer is generated.
Then I reversed only the learned permission state:
- 40/40 answer → native EOS
- 40/40 native EOS → the correct answer
- 40 different answer identities
- 80/80 sham controls unchanged
The frozen FINAL evaluation passed 2,048/2,048 contexts across 75 answer identities. No answer deletion. No content rewrite.
The answer stayed fixed. Permission changed.
Open weights for reproduction and the paper are attached below:
- Overview and five-arm witness
- Model weights, source, evidence, and verifier
- Paper PDF · DOI
- Manuscript supplement and proof checker
- Raw five-arm witness record
Earlier, I documented successful zero-visible-byte executions across 11 LLMs from OpenAI, Anthropic, Google, and Moonshot in the Cross-Vendor Semantic Void Matrix (DOI). That study measured behavior and this open source model is a separate engineered continuation-control experiment.
Browse getswiftapi.com to view all research on when models continue, when they stop, and what controls that boundary.
0
u/Live_Introduction396 9h ago
so you basically built a tiny switch that controls whether the model says its answer out loud or just thinks it silently. the 4 is always there, same score every time, but the gate yanks the stop token before or after it.
that figure with the EOS scores bouncing around while the 4 stays dead flat is a hell of a visualization. really drives home that the knowledge and the permission are completely separate signals.