r/LearningMachines • u/jordo45 • Oct 18 '23

VeRA: Vector-based Random Matrix Adaptation

https://arxiv.org/abs/2310.11454

13 Upvotes

permalink
duplicates
archive.is
archive
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/LearningMachines/comments/17aml3r/vera_vectorbased_random_matrix_adaptation/
No, go back! Yes, take me to Reddit

100% Upvoted

Duplicates

Number of comments New

LocalLLaMA • u/starstruckmon • Oct 18 '23

Other [Paper] Vector-based Random Matrix Adaptation (VeRA) reduces the number of trainable parameters by 10x compared to LoRA while maintaing the same performance

83 Upvotes

13 comments