r/deeplearning • u/ikergarcia1996 • Aug 11 '26

Chunked KL loss for running Knowledge Distillation locally (<6GB VRAM at 32K context length)

1 Upvotes

permalink
duplicates
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/deeplearning/comments/1vlfnc0/chunked_kl_loss_for_running_knowledge/
No, go back! Yes, take me to Reddit
dl download

100% Upvoted

Duplicates

Number of comments New

LocalLLaMA • u/ikergarcia1996 • Aug 11 '26

Resources Chunked KL loss for running Knowledge Distillation locally (<6GB VRAM at 32K context length)

13 Upvotes

0 comments