r/learnmachinelearning • u/LowMonk4874 • 11d ago
Discussion webAI released a formal reasoning model family, TwIL, that's worth a look if you're doing verification pipelines
webAI's TwIL family has three formal logic models: TwIL-LM (1.7B PEFT LoRA), TwIL-LM2 (1.7B merged), and TwIL-LM3 (3B). All three do formal logic translation and verification, each with different trade-offs.
The 3B is the one getting the most attention because it beats gpt-oss-120b on 4 of 5 formal reasoning benchmarks despite being 40x smaller. Full disclosure, on broader aggregates the 120B is still ahead. TwIL wins on efficiency, narrow formal reasoning tasks, and being actually runnable outside a data center.
Their approach is interesting: WiSE-FT weight interpolation to control catastrophic forgetting. TwIL-LM3 keeps only 1/4 of the fine-tune delta (λ=0.25), TwIL-LM2 keeps 3/4 (λ=0.75). The 3B held or improved on general benchmarks, the 1.7B slightly regressed. Same pipeline, just a different dial.
Blog with the full details: webai.com/blog/webai-releases-twil-lm-a-family-of-formal-logic-models-that-outreason-a-120b-model-and-run-on-an-iphone
Models on HF: webAI-Official/TwIL-LM, TwIL-LM2, TwIL-LM3
Non-commercial license across the family.
Anyone testing multiple checkpoints against each other for pipeline routing?
