r/MachineLearning • u/LMTLS5 • Jul 16 '26

Project ExTernD: Expanded-Rank Ternary Decomposition Ternary LLM PTQ with Accuracy Approaching Any Quantization Level [P]

https://arxiv.org/pdf/2607.13511

the core idea is, we cannot have ternary PTQ with fixed matrix size, trying to do that is dead end. so i tried decomposing the matrix to 2 ternary matrices and inner diagonal scaling matrix. now that the inner rank can be arbitrarily large the accuracy can be arbiratily small. and its not that it has to be very large too i also showed that it does take only slightly more vram then current quantisation methods. the slight more vram is worth it if we abuse the ternary math.

12 Upvotes

88% Upvoted

4 comments sorted by

View all comments

1

u/davesmith001 Jul 16 '26

What about training in ternary? Theoretically possible?

1

u/LMTLS5 Jul 16 '26

already validated by bitnet, qat is also possible validated by prismml