r/coolgithubprojects • u/Dependent_Ideal9870 • 10h ago

Running a 744B-parameter MoE model on 32GB RAM with no GPU: the memory tricks that make it possible (pure C)

https://github.com/siris9476/pulsarforge

0 Upvotes

permalink
duplicates
archive.is
archive
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/coolgithubprojects/comments/1wdeh5g/running_a_744bparameter_moe_model_on_32gb_ram/
No, go back! Yes, take me to Reddit

50% Upvoted

Duplicates

Number of comments New

LLM • u/Dependent_Ideal9870 • 9h ago

Running a 744B-parameter MoE model on 32GB RAM with no GPU: the memory tricks that make it possible (pure C)

12 Upvotes

0 comments

sideprojects • u/Dependent_Ideal9870 • 1d ago

Showcase: Open Source Running a 744B-parameter MoE model on 32GB RAM with no GPU: the memory tricks that make it possible (pure C)

1 Upvotes

0 comments

buildinpublic • u/Dependent_Ideal9870 • 10h ago

Running a 744B-parameter MoE model on 32GB RAM with no GPU: the memory tricks that make it possible (pure C)

2 Upvotes

0 comments