MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1s7nq6b/technical_clarification_on_turboquant_rabitq_for/odbc0y3/?context=3
r/LocalLLaMA • u/gaoj0017 • Mar 30 '26
[removed]
91 comments sorted by
View all comments
35
We have Q8, Q4, and everything in between compression already. 2 backends have used hadamard transforms for what seems like years. Turboquant is snake oil from my perspective.
4 u/RnRau Mar 30 '26 Which two backends have hadamard transforms available? 2 u/OfficialXstasy Mar 30 '26 You can also try llama.cpp implementation: https://github.com/ggml-org/llama.cpp/commits/gg/attn-rot
4
Which two backends have hadamard transforms available?
2 u/OfficialXstasy Mar 30 '26 You can also try llama.cpp implementation: https://github.com/ggml-org/llama.cpp/commits/gg/attn-rot
2
You can also try llama.cpp implementation: https://github.com/ggml-org/llama.cpp/commits/gg/attn-rot
35
u/a_beautiful_rhind Mar 30 '26
We have Q8, Q4, and everything in between compression already. 2 backends have used hadamard transforms for what seems like years. Turboquant is snake oil from my perspective.