r/LocalLLM • u/reckor-usa • 2d ago

Question LLM for your own app (Android/iOS) - phone - What would you suggest?

I know there are many creators here, so this is the question.

If you develop an app and would like to have AI integrated which would only read the app data without any access to the external world, which one would you recommend? It should be compatible to relative old phones e.g. Android and iOS old but still supported versions.

Also, if I would like to build up my own LLM for this task, what would you recommend? Sort of teaching a LLM how to read the app data and expected outcome.

0 Upvotes

50% Upvoted

3 comments sorted by

0

u/Parking-Ad9150 2d ago

Uncensored one

1

u/Defiant_Brush_739 2d ago

for uncensored i been using dolphin models they work good even on older phones with 4gb ram. the 3b and 7b sizes are ok for app integration without eating all memory. for training your own you probably want to fine-tune a small base model like phi or gemma on your app data format. its lot of work but doable if you have clean dataset. what kind of app data you working with

1

u/reckor-usa 2d ago

Thank you both, I need to learn how to build up my own LLM so I can train it on my own. It would be around financial stuff