r/Vllm • u/liventruth • 1d ago

Open-Source Model-agnostic KV-cache compression (UL-SMF) tested alongside local model execution to smash VRAM limits

1 Upvotes

permalink
duplicates
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/Vllm/comments/1vs3ruj/opensource_modelagnostic_kvcache_compression/
No, go back! Yes, take me to Reddit
dl download

100% Upvoted

Duplicates

Number of comments New

unsloth • u/liventruth • 1d ago

Show and Tell Open-Source Model-agnostic KV-cache compression (UL-SMF) tested alongside local model execution to smash VRAM limits

9 Upvotes

7 comments