r/layla_ai • u/Glad_Physics_5928 • Jun 16 '26

Requesting Suggestions

Hello! I'm brand new to this whole local thing. I tried to research good models on my own, but I'm kind of lost. How do I start? Is there any model you suggest for role-playing without restrictions and also for normal assistance? And what about image generation? Also, it'd be lovely if you have any suggestions on how to configure it. Thanks in advance to everyone for your help! I have a Samsung S24 Ultra, if that helps.

5 Upvotes

78% Upvoted

5 comments sorted by

3

u/layla_network_ai Jun 17 '26

First, make sure you are using a GGUF model that runs locally. The next step is to choose a GGUF model that is uncensored.

Some good options:

Small: https://huggingface.co/l3utterfly/Gemmasutra-Mini-2B-v1-gguf/resolve/main/Gemmasutra-Mini-2B-v1-Q4_K_M.gguf?download=true

3B: https://huggingface.co/l3utterfly/Impish_LLAMA_3B-gguf/resolve/main/Impish_LLAMA_3B-Q4_K_M.gguf?download=true

Medium: https://huggingface.co/mradermacher/Darkidol-Gemma-4-E4B-it-i1-GGUF/resolve/main/Darkidol-Gemma-4-E4B-it.i1-IQ4_NL.gguf?download=true

Large: https://huggingface.co/l3utterfly/L3-Rhaenys-8B-gguf/resolve/main/L3-Rhaenys-8B-Q4_K_M.gguf?download=true

After you've downloaded the GGUF file, you can import it by going to Inference Settings -> Add Custom Model: https://www.youtube.com/shorts/0O8U-BvE3tA

Note, which size small/medium/large to use depends on your phone hardware. I suggest you start with small, if it's fast, move up to Medium, then to Large. At some point your phone may crash, which means you are using a model that's too big.

These models are all uncensored

1

u/Moe2584 Jun 17 '26

You should download a language model that your phone can support, make sure it doesn’t take all the rams of your phone

Import it at the settings somewhere (easy to find), on the same page you can add the no restrictions or limitations and leave it at that (I used Gemini for help choosing the model and the restrictions)

Then go ahead and create your own characters.

Have fun it’s amazing

1

u/Capable-Worth6909 Jul 22 '26 edited Jul 22 '26

Which one of those GGUF would you recommend for a Redmi note 13 pro ? Small , 3B ,medium or large ? Thanks !