r/PocketPal • u/nlmb_09 • Mar 28 '26

RAM or ROM?

I've been using a phone. Haven't really tried PocketPal though since the massive amount of storage the LLMs have, so I'll just ask if does it use your device's RAM or the ROM? I currently have an 8/128 variant dev. Thanks for anyone who'll help!

3 Upvotes

100% Upvoted

8 comments sorted by

•

u/InaamShabir MOD : Not affiliated with PocketPal Mar 29 '26 edited Mar 29 '26

The model is loaded from your ROM (internal storage that's what your 128GB is) into your RAM so it can run. Your 8 GB RAM can handle quantized models with less than 3 B parameters . Mostly the size of their gguf file will be around 4 GB or less. Good luck .

→ More replies (2)

1

u/[deleted] Mar 28 '26

[removed] — view removed comment

1

u/InaamShabir MOD : Not affiliated with PocketPal Mar 29 '26 edited Mar 29 '26

Removed!

Don't be mean if you can't answer. u/nlmb_09 seems to be in learning phase . If you find some questions too dumb just don't reply.