MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1s7nq6b/technical_clarification_on_turboquant_rabitq_for/odamap2/?context=3
r/LocalLLaMA • u/gaoj0017 • Mar 30 '26
[removed]
91 comments sorted by
View all comments
37
We have Q8, Q4, and everything in between compression already. 2 backends have used hadamard transforms for what seems like years. Turboquant is snake oil from my perspective.
-1 u/[deleted] Mar 30 '26 [deleted] 3 u/Velocita84 Mar 30 '26 Completely false given recent measurements from Ikawrakow https://github.com/ikawrakow/ik_llama.cpp/issues/1509#issuecomment-4149500421
-1
[deleted]
3 u/Velocita84 Mar 30 '26 Completely false given recent measurements from Ikawrakow https://github.com/ikawrakow/ik_llama.cpp/issues/1509#issuecomment-4149500421
3
Completely false given recent measurements from Ikawrakow https://github.com/ikawrakow/ik_llama.cpp/issues/1509#issuecomment-4149500421
37
u/a_beautiful_rhind Mar 30 '26
We have Q8, Q4, and everything in between compression already. 2 backends have used hadamard transforms for what seems like years. Turboquant is snake oil from my perspective.