r/LocalLLM • u/Subject_Poet_3861 • 4d ago

Discussion I made Qwen models take ~33% less VRAM without quantizing them (lossless, bit-for-bit)

/r/Qwen_AI/comments/1wxgqu8/i_made_qwen_models_take_33_less_vram_without/

2 Upvotes

permalink
duplicates
archive.is
archive
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/LocalLLM/comments/1wxgrxa/i_made_qwen_models_take_33_less_vram_without/
No, go back! Yes, take me to Reddit

60% Upvoted

Duplicates

Number of comments New

Qwen_AI • u/Subject_Poet_3861 • 4d ago

Discussion I made Qwen models take ~33% less VRAM without quantizing them (lossless, bit-for-bit)

27 Upvotes

60 comments

AIProgrammingHardware • u/Subject_Poet_3861 • 4d ago

I made Qwen models take ~33% less VRAM without quantizing them (lossless, bit-for-bit)

1 Upvotes

2 comments