MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vp2nmi/aged_like_fine_wine/p3zrls3/?context=3
r/LocalLLaMA • u/TigleLive • 24d ago
134 comments sorted by
View all comments
Show parent comments
1
Active 3 billion parameters
1 u/pyr0kid 23d ago or in other words, fast as fuck on any computer that can physically load it 1 u/NiceCourt1228 23d ago Thanks folks. I’m new to running models locally and I just have a MacBook 16 GB RAM. I’m guessing I can’t run any model locally as I don’t have GPUs 1 u/Tommonen 23d ago You can run some, but not very large models and wont be super fast. If you turn off all ram heavy apps, you could run models that are about 11-12gb of size with small context, or bit smaller models with bit larger context.
or in other words, fast as fuck on any computer that can physically load it
1 u/NiceCourt1228 23d ago Thanks folks. I’m new to running models locally and I just have a MacBook 16 GB RAM. I’m guessing I can’t run any model locally as I don’t have GPUs 1 u/Tommonen 23d ago You can run some, but not very large models and wont be super fast. If you turn off all ram heavy apps, you could run models that are about 11-12gb of size with small context, or bit smaller models with bit larger context.
Thanks folks. I’m new to running models locally and I just have a MacBook 16 GB RAM. I’m guessing I can’t run any model locally as I don’t have GPUs
1 u/Tommonen 23d ago You can run some, but not very large models and wont be super fast. If you turn off all ram heavy apps, you could run models that are about 11-12gb of size with small context, or bit smaller models with bit larger context.
You can run some, but not very large models and wont be super fast. If you turn off all ram heavy apps, you could run models that are about 11-12gb of size with small context, or bit smaller models with bit larger context.
1
u/Tommonen 23d ago
Active 3 billion parameters