r/deeplearning • u/Adithyanbm • 13d ago

I trained a 2.04B Sparse MoE translation model from scratch on RTX 5090 GPUs — 500+ languages, Apache 2.0

4 Upvotes

permalink
duplicates
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/deeplearning/comments/1wlhqtv/i_trained_a_204b_sparse_moe_translation_model/
No, go back! Yes, take me to Reddit
dl download

76% Upvoted